Apr 22 02:31:43 devstack cinder-volume[73015]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 22 02:31:43 devstack cinder-volume[73015]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 22 02:31:43 devstack cinder-volume[73015]: we strongly recommend against using it for new projects.
Apr 22 02:31:43 devstack cinder-volume[73015]: If you are already using Eventlet, we recommend migrating to a different
Apr 22 02:31:43 devstack cinder-volume[73015]: framework.  For more detail see
Apr 22 02:31:43 devstack cinder-volume[73015]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 22 02:31:43 devstack cinder-volume[73015]:   import eventlet  # noqa
Apr 22 02:31:44 devstack cinder-volume[73015]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73015) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 22 02:31:44 devstack cinder-volume[73015]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73015) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 22 02:31:44 devstack cinder-volume[73015]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73015) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO dbcounter [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Registered counter for database cinder
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_db.sqlalchemy.engines [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG dbcounter [-] [73015] Writer thread running {{(pid=73015) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO cinder.rpc [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO cinder.rpc [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_db.sqlalchemy.engines [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO cinder.volume.manager [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Determined volume DB was empty at startup.
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG cinder.volume.manager [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73015) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO cinder.volume.manager [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 22 02:31:45 devstack cinder-volume[73015]: WARNING stevedore.named [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 22 02:31:45 devstack cinder-volume[73015]: WARNING castellan.key_manager [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 22 02:31:45 devstack cinder-volume[73015]: WARNING cinder.keymgr.conf_key_mgr [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG cinder.volume.drivers.lvm [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73015) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_concurrency.processutils [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_concurrency.processutils [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.246s {{(pid=73015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_db.sqlalchemy.engines [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO cinder.rpc [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO cinder.rpc [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 22 02:31:45 devstack cinder-volume[73015]: WARNING stevedore.named [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 22 02:31:45 devstack cinder-volume[73015]: WARNING castellan.key_manager [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO cinder.volume.manager [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_db.sqlalchemy.engines [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73015) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:31:45 devstack cinder-volume[73015]: INFO oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Starting 1 workers
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Started child 73119 {{(pid=73015) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Full set of CONF: {{(pid=73015) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] ******************************************************************************** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Configuration options gathered from: {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] ================================================================================ {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] allow_availability_zone_fallback = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] allow_compression_on_image_upload = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] allowed_direct_url_schemes     = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] api_rate_limit                 = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] auth_strategy                  = keystone {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] az_cache_duration              = 3600 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_availability_zone      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_host                   = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_name                   = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_stats_polling_interval = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backup_api_class               = cinder.backup.api.API {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backup_name_template           = backup-%s {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backup_use_same_host           = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backup_use_temp_snapshot       = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] chap_password                  = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] chap_username                  =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_internal_tenant_project_id = 948a258c92bc40bd8f5900e1ccd7b79e {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_internal_tenant_user_id = f7d09eccb81f4e27aaa755a2440927a7 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cloned_volume_same_az          = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cluster                        = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] compression_format             = gzip {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73119]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] config_dir                     = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] config_source                  = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] control_exchange               = openstack {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] debug                          = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] default_availability_zone      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] default_group_type             = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] default_volume_type            = lvmdriver-1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] disk_geometry                  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] driver_client_cert             = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] driver_client_cert_key         = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] driver_data_namespace          = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] driver_ssl_cert_path           = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] driver_ssl_cert_verify         = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] driver_use_ssl                 = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] enable_force_upload            = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] enable_new_services            = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] enable_unsupported_driver      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] enforce_multipath_for_image_xfer = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] filter_function                = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_api_insecure            = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_api_servers             = ['http://192.168.122.247/image'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_api_ssl_compression     = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_ca_certificates_file    = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_certfile                = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_keyfile                 = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_num_retries             = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance_request_timeout         = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] goodness_function              = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] graceful_shutdown_timeout      = 5 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] group_api_class                = cinder.group.api.API {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] host                           = devstack {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_compress_on_upload       = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_conversion_address_space_limit = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_conversion_cpu_limit     = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_conversion_disable       = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_upload_use_cinder_backend = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_upload_use_internal_tenant = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_volume_cache_enabled     = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_volume_cache_max_count   = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] image_volume_cache_max_size_gb = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] init_host_max_objects_retrieval = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] iscsi_target_flags             =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] iscsi_write_cache              = on {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] iser_helper                    = tgtadm {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] iser_ip_address                = 192.168.122.247 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] iser_port                      = 3260 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_color                      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_config_append              = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_dir                        = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_file                       = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_options                    = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_rotate_interval            = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_rotate_interval_type       = days {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] log_rotation_type              = none {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] max_age                        = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] max_logfile_count              = 30 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] max_logfile_size_mb            = 200 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] max_over_subscription_ratio    = 20.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] message_reap_interval          = 86400 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] message_ttl                    = 2592000 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] migration_create_volume_timeout_secs = 300 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] monkey_patch                   = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] monkey_patch_modules           = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] my_ip                          = 192.168.122.247 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] no_snapshot_gb_quota           = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] num_iser_scan_tries            = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] num_shell_tries                = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] num_volume_device_scan_tries   = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] nvmeof_conn_info_version       = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] nvmet_ns_id                    = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] nvmet_port_id                  = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] osapi_max_limit                = 1000 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] osapi_volume_ext_list          = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] osapi_volume_listen_port       = 8776 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] osapi_volume_use_ssl           = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] osapi_volume_workers           = 2 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] per_volume_size_limit          = -1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] periodic_fuzzy_delay           = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] periodic_interval              = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] public_endpoint                = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] publish_errors                 = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] quota_backup_gigabytes         = 1000 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] quota_backups                  = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] quota_gigabytes                = 1000 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] quota_groups                   = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] quota_snapshots                = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] quota_volumes                  = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] rate_limit_burst               = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] rate_limit_except_level        = CRITICAL {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] rate_limit_interval            = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] reinit_driver_count            = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] replication_device             = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] report_discard_supported       = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] report_interval                = 120 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] reservation_clean_interval     = 86400 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] reservation_expire             = 86400 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] reserved_image_namespaces      = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] reserved_percentage            = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] rpc_response_timeout           = 120 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] run_external_periodic_tasks    = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] scst_target_driver             = iscsi {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] scst_target_iqn_name           = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_down_time              = 720 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] shell_completion               = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] snapshot_name_template         = snapshot-%s {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] snapshot_same_host             = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] split_loggers                  = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] state_path                     = /opt/stack/data/cinder {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] storage_availability_zone      = nova {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] storage_protocol               = iSCSI {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] syslog_log_facility            = LOG_USER {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] target_helper                  = lioadm {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] target_ip_address              = 192.168.122.247 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] target_port                    = 3260 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] target_protocol                = iscsi {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] target_secondary_ip_addresses  = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] trace_flags                    = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73119]: INFO cinder.volume.manager [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] transport_url                  = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] until_refresh                  = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] use_chap_auth                  = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] use_default_quota_class        = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] use_journal                    = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] use_json                       = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] use_multipath_for_image_xfer   = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] use_stderr                     = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] use_syslog                     = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] verify_glance_signatures       = enabled {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_api_class               = cinder.volume.api.API {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_backend_name            = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_clear                   = zero {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_clear_ionice            = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_clear_size              = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_copy_bps_limit          = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_dd_blocksize            = 1M {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_name_template           = volume-%s {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_service_inithost_offload = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volume_usage_audit_period      = month {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] zoning_mode                    = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:31:45 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_concurrency.disable_process_locking = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.admin_password = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.admin_token = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.admin_user  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.auth_port   = 35357 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.auth_protocol = https {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.auth_section = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.auth_type   = password {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.auth_uri    = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.auth_version = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.cache       = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.certfile    = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.identity_uri = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.include_service_catalog = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.insecure    = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.interface   = public {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.keyfile     = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_password =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcache_username =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.region_name = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.service_type = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.backend                  = dogpile.cache.null {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.backend_argument         = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.backend_expiration_time  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.config_prefix            = cache.oslo {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.debug_cache_backend      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.enable_retry_client      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.enable_socket_keepalive  = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.enabled                  = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.enforce_fips_mode        = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.expiration_time          = 600 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.hashclient_retry_attempts = 2 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.memcache_dead_retry      = 300 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.memcache_sasl_enabled    = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.password                 = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.proxies                  = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.redis_db                 = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.redis_server             = localhost:6379 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.retry_attempts           = 2 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.retry_delay              = 0.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.socket_keepalive_count   = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.socket_keepalive_idle    = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.socket_keepalive_interval = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.socket_timeout           = 1.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.tls_allowed_ciphers      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.tls_cafile               = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.tls_certfile             = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.tls_enabled              = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.tls_keyfile              = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cache.username                 = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] coordination.backend_url       = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.asyncio_connection    = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.asyncio_slave_connection = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.backend               = sqlalchemy {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.connection            = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.connection_debug      = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.connection_parameters =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:45 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.connection_recycle_time = 3600 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.connection_trace      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.db_inc_retry_interval = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.db_max_retries        = 20 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.db_max_retry_interval = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.db_retry_interval     = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.max_overflow          = 50 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.max_pool_size         = 5 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.max_retries           = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.mysql_wsrep_sync_wait = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.pool_timeout          = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.retry_interval        = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.slave_connection      = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.sqlite_synchronous    = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.synchronous_reader    = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] database.use_db_reconnect      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.connection_string     = messaging:// {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.enabled               = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.es_doc_type           = notification {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.es_scroll_size        = 10000 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.es_scroll_time        = 2m {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.filter_error_trace    = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.hmac_keys             = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.sentinel_service_name = mymaster {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.socket_timeout        = 0.1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.trace_requests        = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler.trace_sqlalchemy      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler_jaeger.process_tags   = {} {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler_jaeger.service_name_prefix = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] profiler_otlp.service_name_prefix = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.enforce_new_defaults = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: WARNING oslo_config.cfg [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.enforce_scope      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.policy_default_rule = default {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] privsep_osbrick.group          = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] privsep_osbrick.helper_command = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] privsep_osbrick.user           = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_sys_admin.group         = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_sys_admin.helper_command = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] cinder_sys_admin.user          = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.auth_section      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.auth_type         = password {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.cafile            = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.certfile          = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.collect_timing    = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.insecure          = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.keyfile           = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.send_service_user_token = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.split_loggers     = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] service_user.timeout           = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.auth_section            = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.auth_type               = password {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.certfile                = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.collect_timing          = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.insecure                = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.keyfile                 = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.region_name             = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.split_loggers           = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] glance.timeout                 = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.backend_availability_zone = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.chap_password = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.chap_username =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.disk_geometry = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.driver_client_cert = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.driver_client_cert_key = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.driver_data_namespace = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.driver_use_ssl = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.extra_capabilities = {} {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.filter_function = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.goodness_function = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.iscsi_target_flags =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.iscsi_write_cache = on {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.iser_port     = 3260 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.lvm_share_target = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.lvm_type      = auto {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.num_shell_tries = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.replication_device = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.report_discard_supported = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.reserved_percentage = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.target_helper = tgtadm {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.target_port   = 3260 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.target_protocol = iscsi {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.trace_flags   = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.unique_fqdn_network = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.use_chap_auth = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_backend_name = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_clear  = zero {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_clear_ionice = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_clear_size = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_reports.file_event_handler = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_reports.log_dir           = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.backend_host       = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.chap_password      = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.chap_username      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.disk_geometry      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.driver_client_cert = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.extra_capabilities = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.filter_function    = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.goodness_function  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.iser_helper        = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.iser_ip_address    = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.iser_port          = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.lvm_share_target   = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.lvm_type           = auto {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.num_shell_tries    = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.replication_device = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.report_discard_supported = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.reserved_percentage = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.scst_target_driver = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.storage_protocol   = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.target_helper      = lioadm {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.target_ip_address  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.target_port        = 3260 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.trace_flags        = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.use_chap_auth      = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_clear       = zero {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_clear_size  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] lvmdriver-1.volumes_dir        = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.054s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_notifications.driver = [] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_notifications.retry = -1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] key_manager.fixed_key          = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.barbican_api_version  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.barbican_endpoint     = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.barbican_endpoint_type = public {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.barbican_region_name  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.cafile                = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.certfile              = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.collect_timing        = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.insecure              = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.keyfile               = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.number_of_retries     = 60 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.retry_delay           = 1 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.send_service_user_token = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.split_loggers         = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.timeout               = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.verify_ssl            = True {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican.verify_ssl_path       = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.auth_section = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.auth_type = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.cafile   = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:46 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.certfile = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.collect_timing = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.insecure = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.keyfile  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.split_loggers = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] barbican_service_user.timeout  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.approle_role_id          = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.approle_secret_id        = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.kv_mountpoint            = secret {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.kv_path                  = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.kv_version               = 2 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.namespace                = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.root_token_id            = **** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.ssl_ca_crt_file          = None {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.timeout                  = 60.0 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.use_ssl                  = False {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:31:46 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] ******************************************************************************** {{(pid=73015) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 22 02:31:46 devstack sudo[73123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 22 02:31:46 devstack sudo[73123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:46 devstack sudo[73123]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:46 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.510s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:46 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:46 devstack sudo[73161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:46 devstack sudo[73161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:47 devstack sudo[73161]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:47 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.570s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:47 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:31:47 devstack cinder-volume[73119]: INFO cinder.brick.local_dev.lvm [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 22 02:31:47 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:47 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:47 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:47 devstack sudo[73448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 22 02:31:47 devstack sudo[73448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:47 devstack sudo[73448]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:47 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.569s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:47 devstack cinder-volume[73119]: DEBUG cinder.brick.local_dev.lvm [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73119) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 22 02:31:47 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:47 devstack sudo[73644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:47 devstack sudo[73644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:48 devstack sudo[73644]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:48 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.896s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:48 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:48 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:48 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:48 devstack sudo[73787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:48 devstack sudo[73787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:49 devstack sudo[73787]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:49 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.481s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:49 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:49 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:49 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:49 devstack sudo[73815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 22 02:31:49 devstack sudo[73815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:49 devstack sudo[73815]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:49 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.455s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:49 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:49 devstack sudo[73818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 22 02:31:49 devstack sudo[73818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:50 devstack sudo[73818]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:50 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.459s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:50 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:50 devstack sudo[73823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 22 02:31:50 devstack sudo[73823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:50 devstack sudo[73823]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:50 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:50 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:50 devstack sudo[73829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:31:50 devstack sudo[73829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:51 devstack sudo[73829]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:51 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:51 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:51 devstack sudo[73834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:51 devstack sudo[73834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:51 devstack sudo[73834]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:51 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:51 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:51 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:51 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:51 devstack sudo[73839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:51 devstack sudo[73839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:52 devstack sudo[73839]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:52 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:52 devstack cinder-volume[73119]: INFO cinder.volume.drivers.lvm [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 22 02:31:52 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:52 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:52 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:52 devstack sudo[73919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:52 devstack sudo[73919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:52 devstack sudo[73919]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:52 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.438s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:52 devstack cinder-volume[73119]: DEBUG cinder.volume.drivers.lvm [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Updating volume stats {{(pid=73119) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 22 02:31:52 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:52 devstack sudo[73966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 22 02:31:52 devstack sudo[73966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:53 devstack sudo[73966]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:53 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.464s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:53 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:53 devstack sudo[73999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:31:53 devstack sudo[73999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:53 devstack sudo[73999]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:53 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:53 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:53 devstack sudo[74107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:53 devstack sudo[74107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:53 devstack sudo[74107]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:53 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.423s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:53 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:53 devstack sudo[74110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:31:53 devstack sudo[74110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:54 devstack sudo[74110]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:54 devstack cinder-volume[73119]: INFO cinder.volume.driver [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Driver hasn't implemented _init_vendor_properties()
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG cinder.volume.driver [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73119) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG oslo_db.sqlalchemy.engines [None req-e641b806-312f-4093-af84-ba78b945b76a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73119) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG dbcounter [-] [73119] Writer thread running {{(pid=73119) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG cinder.db.sqlalchemy.api [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Building query based on filter {{(pid=73119) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG cinder.image.image_utils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73119) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 22 02:31:54 devstack cinder-volume[73119]: INFO cinder.keymgr.migration [None req-a1ec98e0-8c06-4a1c-8777-0ffbdf5aa6ab None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG cinder.volume.drivers.lvm [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Updating volume stats {{(pid=73119) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:54 devstack sudo[74119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 22 02:31:54 devstack sudo[74119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:54 devstack sudo[74119]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:54 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:54 devstack sudo[74122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:31:54 devstack sudo[74122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:55 devstack sudo[74122]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:55 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:55 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:55 devstack sudo[74125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:55 devstack sudo[74125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:55 devstack sudo[74125]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:55 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.444s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:55 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:55 devstack sudo[74130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:31:55 devstack sudo[74130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:55 devstack cinder-volume[73015]: DEBUG dbcounter [-] [73015] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73015) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:31:56 devstack sudo[74130]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:56 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.557s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:56 devstack cinder-volume[73119]: DEBUG cinder.manager [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Notifying Schedulers of capabilities ... {{(pid=73119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:31:56 devstack cinder-volume[73119]: INFO cinder.volume.manager [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Driver initialization completed successfully.
Apr 22 02:31:56 devstack cinder-volume[73119]: INFO cinder.manager [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Initiating service 2 cleanup
Apr 22 02:31:56 devstack cinder-volume[73119]: INFO cinder.manager [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Service 2 cleanup completed.
Apr 22 02:31:56 devstack cinder-volume[73119]: DEBUG cinder.service [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Creating RPC server for service cinder-volume {{(pid=73119) start /opt/stack/cinder/cinder/service.py:231}}
Apr 22 02:31:56 devstack cinder-volume[73119]: DEBUG cinder.service [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73119) start /opt/stack/cinder/cinder/service.py:237}}
Apr 22 02:31:56 devstack cinder-volume[73119]: INFO cinder.volume.manager [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 22 02:31:56 devstack cinder-volume[73119]: DEBUG cinder.volume.drivers.lvm [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Updating volume stats {{(pid=73119) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 22 02:31:56 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:56 devstack sudo[74139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 22 02:31:56 devstack sudo[74139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:56 devstack sudo[74139]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:56 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:56 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:56 devstack sudo[74142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:31:56 devstack sudo[74142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:57 devstack sudo[74142]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:57 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:57 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:57 devstack sudo[74199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:31:57 devstack sudo[74199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:57 devstack sudo[74199]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:57 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:57 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:31:57 devstack sudo[74202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:31:57 devstack sudo[74202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:31:58 devstack sudo[74202]: pam_unix(sudo:session): session closed for user root
Apr 22 02:31:58 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-e641b806-312f-4093-af84-ba78b945b76a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:31:58 devstack cinder-volume[73119]: INFO cinder.volume.manager [None req-e641b806-312f-4093-af84-ba78b945b76a None None] Driver post RPC initialization completed successfully.
Apr 22 02:32:06 devstack cinder-volume[73119]: DEBUG dbcounter [-] [73119] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73119) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:32:08 devstack cinder-volume[73119]: DEBUG dbcounter [-] [73119] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=73119) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:33:20 devstack cinder-volume[73119]: DEBUG oslo_service.periodic_task [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73119) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:33:20 devstack cinder-volume[73119]: DEBUG cinder.volume.drivers.lvm [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Updating volume stats {{(pid=73119) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 22 02:33:20 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:33:20 devstack sudo[79105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 22 02:33:20 devstack sudo[79105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:33:20 devstack sudo[79105]: pam_unix(sudo:session): session closed for user root
Apr 22 02:33:20 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:33:20 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:33:20 devstack sudo[79116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:33:20 devstack sudo[79116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:33:21 devstack sudo[79116]: pam_unix(sudo:session): session closed for user root
Apr 22 02:33:21 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.444s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:33:21 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:33:21 devstack sudo[79124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:33:21 devstack sudo[79124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:33:21 devstack sudo[79124]: pam_unix(sudo:session): session closed for user root
Apr 22 02:33:21 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.437s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:33:21 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:33:21 devstack sudo[79136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:33:21 devstack sudo[79136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:33:22 devstack sudo[79136]: pam_unix(sudo:session): session closed for user root
Apr 22 02:33:22 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:33:22 devstack cinder-volume[73119]: DEBUG cinder.manager [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Notifying Schedulers of capabilities ... {{(pid=73119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:34:08 devstack cinder-volume[73119]: DEBUG dbcounter [-] [73119] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73119) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:34:20 devstack cinder-volume[73119]: DEBUG oslo_service.periodic_task [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73119) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:34:20 devstack cinder-volume[73119]: DEBUG cinder.volume.drivers.lvm [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Updating volume stats {{(pid=73119) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 22 02:34:20 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:34:20 devstack sudo[81006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 22 02:34:20 devstack sudo[81006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:34:20 devstack sudo[81006]: pam_unix(sudo:session): session closed for user root
Apr 22 02:34:20 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:34:20 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:34:20 devstack sudo[81013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:34:20 devstack sudo[81013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:34:21 devstack sudo[81013]: pam_unix(sudo:session): session closed for user root
Apr 22 02:34:21 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:34:21 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:34:21 devstack sudo[81023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 22 02:34:21 devstack sudo[81023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:34:21 devstack sudo[81023]: pam_unix(sudo:session): session closed for user root
Apr 22 02:34:21 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:34:21 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:34:21 devstack sudo[81027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 22 02:34:21 devstack sudo[81027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:34:22 devstack sudo[81027]: pam_unix(sudo:session): session closed for user root
Apr 22 02:34:22 devstack cinder-volume[73119]: DEBUG oslo_concurrency.processutils [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73119) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:34:22 devstack cinder-volume[73119]: DEBUG cinder.manager [None req-61efcc88-c7d5-4806-8d93-d49d0a195a8c None None] Notifying Schedulers of capabilities ... {{(pid=73119) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:35:15 devstack cinder-volume[73015]: INFO oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Caught SIGTERM, stopping children
Apr 22 02:35:15 devstack cinder-volume[73015]: DEBUG oslo_concurrency.lockutils [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Acquiring lock "singleton_lock" {{(pid=73015) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 22 02:35:15 devstack cinder-volume[73015]: DEBUG oslo_concurrency.lockutils [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Acquired lock "singleton_lock" {{(pid=73015) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 22 02:35:15 devstack cinder-volume[73015]: DEBUG oslo_concurrency.lockutils [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Releasing lock "singleton_lock" {{(pid=73015) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 22 02:35:15 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Stop services. {{(pid=73015) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 22 02:35:15 devstack cinder-volume[73015]: DEBUG oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Killing children. {{(pid=73015) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 22 02:35:15 devstack cinder-volume[73015]: INFO oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Waiting on 1 children to exit
Apr 22 02:35:16 devstack cinder-volume[73119]: DEBUG oslo_concurrency.lockutils [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Acquiring lock "singleton_lock" {{(pid=73119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 22 02:35:16 devstack cinder-volume[73119]: DEBUG oslo_concurrency.lockutils [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Acquired lock "singleton_lock" {{(pid=73119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 22 02:35:16 devstack cinder-volume[73119]: DEBUG oslo_concurrency.lockutils [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Releasing lock "singleton_lock" {{(pid=73119) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 22 02:35:16 devstack cinder-volume[73119]: WARNING amqp [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 22 02:35:16 devstack cinder-volume[73119]: WARNING amqp [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 22 02:35:16 devstack cinder-volume[73015]: INFO oslo_service.backend._eventlet.service [None req-31cf7baf-2514-44aa-850a-753a69b0fae4 None None] Child 73119 exited with status 0
Apr 22 02:35:16 devstack cinder-volume[82202]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 22 02:35:16 devstack cinder-volume[82202]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 22 02:35:16 devstack cinder-volume[82202]: we strongly recommend against using it for new projects.
Apr 22 02:35:16 devstack cinder-volume[82202]: If you are already using Eventlet, we recommend migrating to a different
Apr 22 02:35:16 devstack cinder-volume[82202]: framework.  For more detail see
Apr 22 02:35:16 devstack cinder-volume[82202]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 22 02:35:16 devstack cinder-volume[82202]:   import eventlet  # noqa
Apr 22 02:35:18 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 22 02:35:18 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 22 02:35:18 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 22 02:35:19 devstack cinder-volume[82202]: INFO dbcounter [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Registered counter for database cinder
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_db.sqlalchemy.engines [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG dbcounter [-] [82202] Writer thread running {{(pid=82202) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 22 02:35:19 devstack cinder-volume[82202]: INFO cinder.rpc [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 22 02:35:19 devstack cinder-volume[82202]: INFO cinder.rpc [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_db.sqlalchemy.engines [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:35:19 devstack cinder-volume[82202]: INFO cinder.volume.manager [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Determined volume DB was empty at startup.
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG cinder.volume.manager [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82202) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 22 02:35:19 devstack cinder-volume[82202]: INFO cinder.volume.manager [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 22 02:35:19 devstack cinder-volume[82202]: WARNING stevedore.named [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 22 02:35:19 devstack cinder-volume[82202]: WARNING castellan.key_manager [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 22 02:35:19 devstack cinder-volume[82202]: WARNING cinder.keymgr.conf_key_mgr [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 22 02:35:19 devstack cinder-volume[82202]: INFO cinder.volume.manager [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_db.sqlalchemy.engines [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:35:19 devstack cinder-volume[82202]: INFO oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Starting 1 workers
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Started child 82321 {{(pid=82202) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Full set of CONF: {{(pid=82202) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] ******************************************************************************** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Configuration options gathered from: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] ================================================================================ {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] allow_availability_zone_fallback = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] allow_compression_on_image_upload = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] allowed_direct_url_schemes     = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] api_rate_limit                 = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] auth_strategy                  = keystone {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_availability_zone      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_host                   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_name                   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_stats_polling_interval = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backup_api_class               = cinder.backup.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backup_name_template           = backup-%s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backup_use_same_host           = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backup_use_temp_snapshot       = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] chap_password                  = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] chap_username                  =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_internal_tenant_project_id = 948a258c92bc40bd8f5900e1ccd7b79e {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_internal_tenant_user_id = f7d09eccb81f4e27aaa755a2440927a7 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cluster                        = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] compression_format             = gzip {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] config_dir                     = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] config_source                  = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] control_exchange               = openstack {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] debug                          = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] default_availability_zone      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] default_group_type             = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82321]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] default_volume_type            = QuobyteHD {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] disk_geometry                  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] driver_client_cert             = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] driver_client_cert_key         = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] driver_data_namespace          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] driver_ssl_cert_path           = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] driver_ssl_cert_verify         = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] driver_use_ssl                 = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] enable_new_services            = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] enable_unsupported_driver      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] enforce_multipath_for_image_xfer = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] filter_function                = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_api_insecure            = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_api_servers             = ['http://192.168.122.247/image'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_api_ssl_compression     = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_ca_certificates_file    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_certfile                = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_keyfile                 = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_num_retries             = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance_request_timeout         = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] goodness_function              = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] graceful_shutdown_timeout      = 5 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] group_api_class                = cinder.group.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] host                           = devstack {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_compress_on_upload       = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_conversion_address_space_limit = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_conversion_cpu_limit     = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_conversion_disable       = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_upload_use_cinder_backend = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_upload_use_internal_tenant = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_volume_cache_enabled     = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_volume_cache_max_count   = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] image_volume_cache_max_size_gb = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] init_host_max_objects_retrieval = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] iscsi_target_flags             =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] iscsi_write_cache              = on {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] iser_helper                    = tgtadm {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] iser_ip_address                = 192.168.122.247 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] iser_port                      = 3260 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_color                      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_config_append              = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_dir                        = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_file                       = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_options                    = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_rotate_interval            = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_rotate_interval_type       = days {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] log_rotation_type              = none {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] max_age                        = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] max_logfile_count              = 30 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] max_logfile_size_mb            = 200 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] max_over_subscription_ratio    = 20.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] message_reap_interval          = 86400 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] message_ttl                    = 2592000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] migration_create_volume_timeout_secs = 300 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] monkey_patch                   = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] monkey_patch_modules           = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] my_ip                          = 192.168.122.247 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] no_snapshot_gb_quota           = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] num_iser_scan_tries            = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] num_shell_tries                = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] num_volume_device_scan_tries   = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] nvmeof_conn_info_version       = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] nvmet_ns_id                    = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] nvmet_port_id                  = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] osapi_max_limit                = 1000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] osapi_volume_ext_list          = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] osapi_volume_listen_port       = 8776 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] osapi_volume_use_ssl           = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] osapi_volume_workers           = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] per_volume_size_limit          = -1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] periodic_fuzzy_delay           = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] periodic_interval              = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] public_endpoint                = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] publish_errors                 = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] quota_backup_gigabytes         = 1000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] quota_backups                  = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] quota_gigabytes                = 1000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] quota_groups                   = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] quota_snapshots                = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] quota_volumes                  = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] rate_limit_burst               = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] rate_limit_except_level        = CRITICAL {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] rate_limit_interval            = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] reinit_driver_count            = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] replication_device             = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] report_discard_supported       = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] report_interval                = 120 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] reservation_clean_interval     = 86400 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] reservation_expire             = 86400 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] reserved_image_namespaces      = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] reserved_percentage            = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] rpc_response_timeout           = 120 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] run_external_periodic_tasks    = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] scst_target_driver             = iscsi {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] scst_target_iqn_name           = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_down_time              = 720 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] shell_completion               = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] snapshot_name_template         = snapshot-%s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] split_loggers                  = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] state_path                     = /opt/stack/data/cinder {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] storage_availability_zone      = nova {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] storage_protocol               = iSCSI {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] syslog_log_facility            = LOG_USER {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] target_helper                  = lioadm {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] target_ip_address              = 192.168.122.247 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] target_port                    = 3260 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] target_protocol                = iscsi {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] target_secondary_ip_addresses  = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] trace_flags                    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] transport_url                  = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] until_refresh                  = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] use_chap_auth                  = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] use_default_quota_class        = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] use_journal                    = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] use_json                       = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] use_multipath_for_image_xfer   = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] use_stderr                     = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] use_syslog                     = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] verify_glance_signatures       = enabled {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_api_class               = cinder.volume.api.API {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_backend_name            = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_clear                   = zero {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_clear_ionice            = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_clear_size              = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_copy_bps_limit          = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_dd_blocksize            = 1M {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_name_template           = volume-%s {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_service_inithost_offload = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volume_usage_audit_period      = month {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] zoning_mode                    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_concurrency.disable_process_locking = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.admin_password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.admin_token = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.admin_user  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.auth_protocol = https {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.auth_section = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.auth_type   = password {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.auth_uri    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.auth_version = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.cache       = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.certfile    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.identity_uri = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.include_service_catalog = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.insecure    = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.interface   = public {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.keyfile     = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_password =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcache_username =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.region_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.service_type = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.backend                  = dogpile.cache.null {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.backend_argument         = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.backend_expiration_time  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.config_prefix            = cache.oslo {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.debug_cache_backend      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.enable_retry_client      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.enable_socket_keepalive  = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.enabled                  = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.enforce_fips_mode        = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.expiration_time          = 600 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.hashclient_retry_attempts = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.memcache_dead_retry      = 300 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.memcache_sasl_enabled    = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.password                 = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.proxies                  = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.redis_db                 = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.redis_server             = localhost:6379 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.retry_attempts           = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.retry_delay              = 0.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.socket_keepalive_count   = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.socket_keepalive_idle    = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.socket_keepalive_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.socket_timeout           = 1.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.tls_allowed_ciphers      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.tls_cafile               = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.tls_certfile             = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.tls_enabled              = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.tls_keyfile              = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cache.username                 = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] coordination.backend_url       = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.asyncio_connection    = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.asyncio_slave_connection = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.backend               = sqlalchemy {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.connection            = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.connection_debug      = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.connection_parameters =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.connection_recycle_time = 3600 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.connection_trace      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.db_inc_retry_interval = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.db_max_retries        = 20 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.db_max_retry_interval = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.db_retry_interval     = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.max_overflow          = 50 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.max_pool_size         = 5 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.max_retries           = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.mysql_wsrep_sync_wait = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.pool_timeout          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.retry_interval        = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.slave_connection      = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.sqlite_synchronous    = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.synchronous_reader    = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] database.use_db_reconnect      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.connection_string     = messaging:// {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.enabled               = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.es_doc_type           = notification {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.es_scroll_size        = 10000 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.es_scroll_time        = 2m {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.filter_error_trace    = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.hmac_keys             = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.sentinel_service_name = mymaster {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.socket_timeout        = 0.1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.trace_requests        = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler.trace_sqlalchemy      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler_jaeger.process_tags   = {} {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler_jaeger.service_name_prefix = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] profiler_otlp.service_name_prefix = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.enforce_new_defaults = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: WARNING oslo_config.cfg [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.enforce_scope      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.policy_default_rule = default {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] privsep_osbrick.group          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] privsep_osbrick.helper_command = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] privsep_osbrick.user           = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_sys_admin.group         = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_sys_admin.helper_command = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] cinder_sys_admin.user          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.auth_section      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.auth_type         = password {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.cafile            = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.certfile          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.collect_timing    = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.insecure          = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.keyfile           = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.send_service_user_token = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.split_loggers     = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] service_user.timeout           = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.auth_section            = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.auth_type               = password {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.certfile                = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.collect_timing          = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.insecure                = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.keyfile                 = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.region_name             = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.split_loggers           = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] glance.timeout                 = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.backend_availability_zone = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.chap_password = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.chap_username =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.disk_geometry = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.driver_client_cert = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.driver_client_cert_key = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.driver_data_namespace = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.driver_use_ssl = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.extra_capabilities = {} {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.filter_function = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.goodness_function = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.iscsi_target_flags =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.iscsi_write_cache = on {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.iser_port     = 3260 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_host      =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_login     = admin {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_mount_options = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_password  = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_private_key =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_share_path =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.num_shell_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.quobyte_volume_url = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.replication_device = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.report_discard_supported = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.reserved_percentage = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.target_helper = tgtadm {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.target_port   = 3260 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.target_protocol = iscsi {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.trace_flags   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.unique_fqdn_network = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.use_chap_auth = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volume_backend_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volume_clear  = zero {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volume_clear_ionice = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volume_clear_size = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_reports.file_event_handler = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_reports.log_dir           = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.backend_availability_zone = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.backend_host         = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.chap_password        = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.chap_username        = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.disk_geometry        = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.driver_client_cert   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.driver_data_namespace = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.extra_capabilities   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.filter_function      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.goodness_function    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.iser_helper          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.iser_ip_address      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.iser_port            = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_host             = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_login            = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_mount_options    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_password         = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_private_key      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_share_path       = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.num_shell_tries      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.replication_device   = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.report_discard_supported = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.reserved_percentage  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.scst_target_driver   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.storage_protocol     = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.target_helper        = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.target_ip_address    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.target_port          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.target_prefix        = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.target_protocol      = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.trace_flags          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.use_chap_auth        = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volume_clear         = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volume_clear_size    = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] QuobyteHD.volumes_dir          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_notifications.driver = [] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_notifications.retry = -1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] key_manager.fixed_key          = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82321]: INFO cinder.volume.manager [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.barbican_api_version  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.barbican_endpoint     = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.barbican_endpoint_type = public {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.barbican_region_name  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.cafile                = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.certfile              = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.collect_timing        = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.insecure              = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.keyfile               = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.number_of_retries     = 60 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.retry_delay           = 1 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.send_service_user_token = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.split_loggers         = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.timeout               = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.verify_ssl            = True {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican.verify_ssl_path       = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.auth_section = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.auth_type = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.cafile   = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.certfile = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.collect_timing = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.insecure = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.keyfile  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.split_loggers = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] barbican_service_user.timeout  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.approle_role_id          = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.approle_secret_id        = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.kv_mountpoint            = secret {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.kv_path                  = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.kv_version               = 2 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.namespace                = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.root_token_id            = **** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.ssl_ca_crt_file          = None {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.timeout                  = 60.0 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.use_ssl                  = False {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.remotefs [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82321) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:19 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] ******************************************************************************** {{(pid=82202) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 22 02:35:19 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82321) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 22 02:35:19 devstack cinder-volume[82321]: WARNING cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 22 02:35:19 devstack cinder-volume[82321]: WARNING cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 22 02:35:19 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Running cmd (subprocess): mount.quobyte {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:19 devstack quobyte-client[82322]: Reading configuration file: /etc/quobyte/client.cfg
Apr 22 02:35:19 devstack quobyte-client[82322]: Invalid parameters found, error: missing mount point.
Apr 22 02:35:19 devstack quobyte-client[82322]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 22 02:35:19 devstack quobyte-client[82322]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 22 02:35:19 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:19 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:35:19 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:35:19 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82321) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:35:19 devstack cinder-volume[82321]: INFO cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e ...
Apr 22 02:35:19 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 -c /etc/quobyte/client-cinder.cfg {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:19 devstack sudo[82323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 -c /etc/quobyte/client-cinder.cfg
Apr 22 02:35:19 devstack sudo[82323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:35:20 devstack sudo[82323]: pam_unix(sudo:session): session closed for user root
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.519s {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:20 devstack cinder-volume[82321]: INFO cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e succeeded
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82321) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.543s {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:20 devstack sudo[82392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:35:20 devstack sudo[82392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:35:20 devstack sudo[82392]: pam_unix(sudo:session): session closed for user root
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.398s {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:20 devstack cinder-volume[82321]: INFO cinder.volume.driver [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Driver hasn't implemented _init_vendor_properties()
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG cinder.volume.driver [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82321) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_db.sqlalchemy.engines [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82321) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG dbcounter [-] [82321] Writer thread running {{(pid=82321) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG cinder.db.sqlalchemy.api [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Building query based on filter {{(pid=82321) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG cinder.image.image_utils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82321) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 22 02:35:20 devstack cinder-volume[82321]: INFO cinder.keymgr.migration [None req-b09c1817-9935-4a7d-8d6f-695fa0888dd7 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82321) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82321) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:35:20 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:20 devstack sudo[82396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:35:20 devstack sudo[82396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:35:21 devstack sudo[82396]: pam_unix(sudo:session): session closed for user root
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.394s {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG cinder.manager [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Notifying Schedulers of capabilities ... {{(pid=82321) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:35:21 devstack cinder-volume[82321]: INFO cinder.volume.manager [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Driver initialization completed successfully.
Apr 22 02:35:21 devstack cinder-volume[82321]: INFO cinder.manager [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Initiating service 3 cleanup
Apr 22 02:35:21 devstack cinder-volume[82321]: INFO cinder.manager [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Service 3 cleanup completed.
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG cinder.service [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Creating RPC server for service cinder-volume {{(pid=82321) start /opt/stack/cinder/cinder/service.py:231}}
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG cinder.service [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82321) start /opt/stack/cinder/cinder/service.py:237}}
Apr 22 02:35:21 devstack cinder-volume[82321]: INFO cinder.volume.manager [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82321) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82321) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:21 devstack sudo[82402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:35:21 devstack sudo[82402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:35:21 devstack sudo[82402]: pam_unix(sudo:session): session closed for user root
Apr 22 02:35:21 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.438s {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:21 devstack cinder-volume[82321]: INFO cinder.volume.manager [None req-91e40282-3286-4fad-8610-712d36acbc2f None None] Driver post RPC initialization completed successfully.
Apr 22 02:35:24 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-857bf3cc-1a42-446b-8cec-c2d522476779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:35:24 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-857bf3cc-1a42-446b-8cec-c2d522476779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:35:24 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-857bf3cc-1a42-446b-8cec-c2d522476779 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82321) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:35:24 devstack cinder-volume[82321]: DEBUG cinder.volume.drivers.quobyte [None req-857bf3cc-1a42-446b-8cec-c2d522476779 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82321) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:35:24 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-857bf3cc-1a42-446b-8cec-c2d522476779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82321) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:35:24 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-857bf3cc-1a42-446b-8cec-c2d522476779 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:24 devstack sudo[82468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:35:24 devstack sudo[82468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:35:25 devstack sudo[82468]: pam_unix(sudo:session): session closed for user root
Apr 22 02:35:25 devstack cinder-volume[82321]: DEBUG oslo_concurrency.processutils [None req-857bf3cc-1a42-446b-8cec-c2d522476779 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.395s {{(pid=82321) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:25 devstack cinder-volume[82321]: DEBUG cinder.manager [None req-857bf3cc-1a42-446b-8cec-c2d522476779 None None] Notifying Schedulers of capabilities ... {{(pid=82321) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:35:28 devstack cinder-volume[82202]: INFO oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Caught SIGTERM, stopping children
Apr 22 02:35:28 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Acquiring lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 22 02:35:28 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Acquired lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 22 02:35:28 devstack cinder-volume[82202]: DEBUG oslo_concurrency.lockutils [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Releasing lock "singleton_lock" {{(pid=82202) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 22 02:35:28 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Stop services. {{(pid=82202) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 22 02:35:28 devstack cinder-volume[82202]: DEBUG oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Killing children. {{(pid=82202) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 22 02:35:28 devstack cinder-volume[82202]: INFO oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Waiting on 1 children to exit
Apr 22 02:35:29 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Acquiring lock "singleton_lock" {{(pid=82321) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 22 02:35:29 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Acquired lock "singleton_lock" {{(pid=82321) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 22 02:35:29 devstack cinder-volume[82321]: DEBUG oslo_concurrency.lockutils [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Releasing lock "singleton_lock" {{(pid=82321) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 22 02:35:29 devstack cinder-volume[82321]: WARNING amqp [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 22 02:35:29 devstack cinder-volume[82321]: WARNING amqp [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 22 02:35:29 devstack cinder-volume[82202]: INFO oslo_service.backend._eventlet.service [None req-2978ca87-5da4-4da7-a258-e72b7fa76139 None None] Child 82321 exited with status 0
Apr 22 02:35:29 devstack cinder-volume[82543]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 22 02:35:29 devstack cinder-volume[82543]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 22 02:35:29 devstack cinder-volume[82543]: we strongly recommend against using it for new projects.
Apr 22 02:35:29 devstack cinder-volume[82543]: If you are already using Eventlet, we recommend migrating to a different
Apr 22 02:35:29 devstack cinder-volume[82543]: framework.  For more detail see
Apr 22 02:35:29 devstack cinder-volume[82543]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 22 02:35:29 devstack cinder-volume[82543]:   import eventlet  # noqa
Apr 22 02:35:31 devstack cinder-volume[82543]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 22 02:35:31 devstack cinder-volume[82543]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 22 02:35:31 devstack cinder-volume[82543]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82543) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 22 02:35:31 devstack cinder-volume[82543]: INFO dbcounter [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Registered counter for database cinder
Apr 22 02:35:31 devstack cinder-volume[82543]: DEBUG oslo_db.sqlalchemy.engines [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG dbcounter [-] [82543] Writer thread running {{(pid=82543) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 22 02:35:32 devstack cinder-volume[82543]: INFO cinder.rpc [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 22 02:35:32 devstack cinder-volume[82543]: INFO cinder.rpc [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_db.sqlalchemy.engines [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:35:32 devstack cinder-volume[82543]: INFO cinder.volume.manager [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Determined volume DB was empty at startup.
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG cinder.volume.manager [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82543) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 22 02:35:32 devstack cinder-volume[82543]: WARNING stevedore.named [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 22 02:35:32 devstack cinder-volume[82543]: WARNING castellan.key_manager [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 22 02:35:32 devstack cinder-volume[82543]: WARNING cinder.keymgr.conf_key_mgr [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 22 02:35:32 devstack cinder-volume[82543]: INFO cinder.volume.manager [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_db.sqlalchemy.engines [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:35:32 devstack cinder-volume[82543]: INFO oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Starting 1 workers
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Started child 82678 {{(pid=82543) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Full set of CONF: {{(pid=82543) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] ******************************************************************************** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Configuration options gathered from: {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] ================================================================================ {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] allow_availability_zone_fallback = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] allow_compression_on_image_upload = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] allowed_direct_url_schemes     = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] api_rate_limit                 = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] auth_strategy                  = keystone {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_availability_zone      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_host                   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_name                   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_stats_polling_interval = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backup_api_class               = cinder.backup.api.API {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backup_name_template           = backup-%s {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backup_use_same_host           = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backup_use_temp_snapshot       = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] chap_password                  = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] chap_username                  =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_internal_tenant_project_id = 948a258c92bc40bd8f5900e1ccd7b79e {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_internal_tenant_user_id = f7d09eccb81f4e27aaa755a2440927a7 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cluster                        = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] compression_format             = gzip {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] compute_api_class              = cinder.compute.nova.API {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] config_dir                     = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] config_source                  = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] control_exchange               = openstack {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] debug                          = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] default_availability_zone      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] default_group_type             = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] default_volume_type            = QuobyteHD {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] disk_geometry                  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] driver_client_cert             = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] driver_client_cert_key         = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] driver_data_namespace          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] driver_ssl_cert_path           = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] driver_ssl_cert_verify         = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] driver_use_ssl                 = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] enable_new_services            = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] enable_unsupported_driver      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] enabled_backends               = ['QuobyteHD'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] enforce_multipath_for_image_xfer = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] filter_function                = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_api_insecure            = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_api_servers             = ['http://192.168.122.247/image'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_api_ssl_compression     = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_ca_certificates_file    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_catalog_info            = image:glance:publicURL {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_certfile                = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_keyfile                 = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_num_retries             = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance_request_timeout         = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] goodness_function              = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] graceful_shutdown_timeout      = 5 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] group_api_class                = cinder.group.api.API {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] host                           = devstack {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_compress_on_upload       = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_conversion_address_space_limit = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_conversion_cpu_limit     = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_conversion_disable       = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_upload_use_cinder_backend = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_upload_use_internal_tenant = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_volume_cache_enabled     = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_volume_cache_max_count   = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] image_volume_cache_max_size_gb = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] init_host_max_objects_retrieval = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] instance_format                = [instance: %(uuid)s]  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] iscsi_target_flags             =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] iscsi_write_cache              = on {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] iser_helper                    = tgtadm {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82678]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] iser_ip_address                = 192.168.122.247 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] iser_port                      = 3260 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_color                      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_config_append              = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_dir                        = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_file                       = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_options                    = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_rotate_interval            = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_rotate_interval_type       = days {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] log_rotation_type              = none {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] max_age                        = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] max_logfile_count              = 30 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] max_logfile_size_mb            = 200 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] max_over_subscription_ratio    = 20.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] message_reap_interval          = 86400 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] message_ttl                    = 2592000 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] migration_create_volume_timeout_secs = 300 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] monkey_patch                   = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] monkey_patch_modules           = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] my_ip                          = 192.168.122.247 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] no_snapshot_gb_quota           = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] num_iser_scan_tries            = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] num_shell_tries                = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] num_volume_device_scan_tries   = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] nvmeof_conn_info_version       = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] nvmet_ns_id                    = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] nvmet_port_id                  = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] osapi_max_limit                = 1000 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] osapi_volume_ext_list          = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] osapi_volume_listen_port       = 8776 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] osapi_volume_use_ssl           = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] osapi_volume_workers           = 2 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] per_volume_size_limit          = -1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] periodic_fuzzy_delay           = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] periodic_interval              = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] public_endpoint                = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] publish_errors                 = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] quota_backup_gigabytes         = 1000 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] quota_backups                  = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] quota_gigabytes                = 1000 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] quota_groups                   = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] quota_snapshots                = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] quota_volumes                  = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] rate_limit_burst               = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] rate_limit_except_level        = CRITICAL {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] rate_limit_interval            = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] reinit_driver_count            = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] replication_device             = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] report_discard_supported       = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] report_interval                = 120 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] reservation_clean_interval     = 86400 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] reservation_expire             = 86400 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] reserved_image_namespaces      = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] reserved_percentage            = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] rpc_response_timeout           = 120 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] run_external_periodic_tasks    = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] scst_target_driver             = iscsi {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] scst_target_iqn_name           = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_down_time              = 720 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] shell_completion               = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] snapshot_name_template         = snapshot-%s {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] split_loggers                  = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] state_path                     = /opt/stack/data/cinder {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] storage_availability_zone      = nova {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] storage_protocol               = iSCSI {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] syslog_log_facility            = LOG_USER {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] target_helper                  = lioadm {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] target_ip_address              = 192.168.122.247 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] target_port                    = 3260 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] target_protocol                = iscsi {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] target_secondary_ip_addresses  = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] trace_flags                    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] transport_url                  = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] until_refresh                  = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] use_chap_auth                  = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] use_default_quota_class        = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] use_journal                    = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] use_json                       = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] use_multipath_for_image_xfer   = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] use_stderr                     = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] use_syslog                     = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] verify_glance_signatures       = enabled {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_api_class               = cinder.volume.api.API {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_backend_name            = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_clear                   = zero {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_clear_ionice            = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_clear_size              = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_copy_bps_limit          = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_dd_blocksize            = 1M {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_name_template           = volume-%s {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_service_inithost_offload = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volume_usage_audit_period      = month {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] zoning_mode                    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_concurrency.disable_process_locking = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.admin_password = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.admin_token = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.admin_user  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.auth_port   = 35357 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.auth_protocol = https {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.auth_section = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.auth_type   = password {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.auth_uri    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.auth_version = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.cache       = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.certfile    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.delay_auth_decision = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.http_connect_timeout = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.identity_uri = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.include_service_catalog = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.insecure    = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.interface   = public {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.keyfile     = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_password =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcache_username =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.region_name = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.service_token_roles_required = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.service_type = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.token_cache_time = 300 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82678) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.247/identity {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.backend                  = dogpile.cache.null {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.backend_argument         = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.backend_expiration_time  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.config_prefix            = cache.oslo {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.debug_cache_backend      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.enable_retry_client      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.enable_socket_keepalive  = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.enabled                  = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.enforce_fips_mode        = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.expiration_time          = 600 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.hashclient_retry_attempts = 2 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.memcache_dead_retry      = 300 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.memcache_pool_maxsize    = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.memcache_sasl_enabled    = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.password                 = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.proxies                  = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.redis_db                 = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.redis_sentinel_service_name = mymaster {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.redis_server             = localhost:6379 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.retry_attempts           = 2 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.retry_delay              = 0.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.socket_keepalive_count   = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.socket_keepalive_idle    = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.socket_keepalive_interval = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.socket_timeout           = 1.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.tls_allowed_ciphers      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.tls_cafile               = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.tls_certfile             = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.tls_enabled              = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.tls_keyfile              = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cache.username                 = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] coordination.backend_url       = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.asyncio_connection    = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.asyncio_slave_connection = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.backend               = sqlalchemy {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.connection            = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.connection_debug      = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.connection_parameters =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.connection_recycle_time = 3600 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.connection_trace      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.db_inc_retry_interval = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.db_max_retries        = 20 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.db_max_retry_interval = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.db_retry_interval     = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.max_overflow          = 50 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.max_pool_size         = 5 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.max_retries           = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.mysql_wsrep_sync_wait = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.pool_timeout          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.retry_interval        = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.slave_connection      = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.sqlite_synchronous    = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.synchronous_reader    = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] database.use_db_reconnect      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.connection_string     = messaging:// {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.enabled               = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.es_doc_type           = notification {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.es_scroll_size        = 10000 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.es_scroll_time        = 2m {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.filter_error_trace    = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.hmac_keys             = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.sentinel_service_name = mymaster {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.socket_timeout        = 0.1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.trace_requests        = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler.trace_sqlalchemy      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler_jaeger.process_tags   = {} {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler_jaeger.service_name_prefix = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] profiler_otlp.service_name_prefix = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.enforce_new_defaults = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: WARNING oslo_config.cfg [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.enforce_scope      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.policy_default_rule = default {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.policy_file        = policy.yaml {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] privsep_osbrick.group          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] privsep_osbrick.helper_command = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] privsep_osbrick.user           = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_sys_admin.group         = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_sys_admin.helper_command = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] cinder_sys_admin.user          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.auth_section      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.auth_type         = password {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.cafile            = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.certfile          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.collect_timing    = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.insecure          = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.keyfile           = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.send_service_user_token = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.split_loggers     = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] service_user.timeout           = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.auth_section            = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.auth_type               = password {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.certfile                = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.collect_timing          = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.insecure                = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.keyfile                 = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.region_name             = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.split_loggers           = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] glance.timeout                 = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.backend_availability_zone = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.chap_password = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.chap_username =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.disk_geometry = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.driver_client_cert = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.driver_client_cert_key = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.driver_data_namespace = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.driver_use_ssl = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.enable_unsupported_driver = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.extra_capabilities = {} {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.filter_function = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.goodness_function = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.iscsi_target_flags =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.iscsi_write_cache = on {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.iser_helper   = tgtadm {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.iser_ip_address = 192.168.122.247 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.iser_port     = 3260 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_host      =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_login     = admin {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_mount_options = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_password  = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_private_key =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_share_path =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.num_shell_tries = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.nvmet_port_id = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.quobyte_client_cfg = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.quobyte_volume_url = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.replication_device = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.report_discard_supported = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.reserved_percentage = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.scst_target_driver = iscsi {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.scst_target_iqn_name = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.storage_protocol = iSCSI {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.target_helper = tgtadm {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.target_ip_address = 192.168.122.247 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.target_port   = 3260 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.target_protocol = iscsi {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.trace_flags   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.unique_fqdn_network = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.use_chap_auth = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volume_backend_name = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volume_clear  = zero {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volume_clear_ionice = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volume_clear_size = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_reports.file_event_handler = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_reports.log_dir           = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.backend_availability_zone = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.backend_host         = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.chap_password        = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.chap_username        = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.chiscsi_conf         = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.disk_geometry        = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.driver_client_cert   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.driver_client_cert_key = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.driver_data_namespace = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.driver_use_ssl       = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.extra_capabilities   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.filter_function      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.goodness_function    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.iser_helper          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.iser_ip_address      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.iser_port            = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.iser_target_prefix   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_host             = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_login            = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_mount_options    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_password         = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_private_key      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_share_path       = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_ssh_port         = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.num_shell_tries      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.nvmet_port_id        = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.replication_device   = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.report_discard_supported = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.reserved_percentage  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.scst_target_driver   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.storage_protocol     = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.target_helper        = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.target_ip_address    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.target_port          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.target_prefix        = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.target_protocol      = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.trace_flags          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.use_chap_auth        = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volume_clear         = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volume_clear_size    = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] QuobyteHD.volumes_dir          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.ssl      = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_notifications.driver = [] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_notifications.retry = -1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] key_manager.fixed_key          = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.barbican_api_version  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.barbican_endpoint     = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.barbican_endpoint_type = public {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.barbican_region_name  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.cafile                = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.certfile              = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.collect_timing        = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.insecure              = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.keyfile               = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.number_of_retries     = 60 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.retry_delay           = 1 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.send_service_user_token = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.split_loggers         = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.timeout               = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.verify_ssl            = True {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican.verify_ssl_path       = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.auth_section = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.auth_type = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.cafile   = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.certfile = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.collect_timing = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.insecure = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.keyfile  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.split_loggers = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] barbican_service_user.timeout  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.approle_role_id          = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.approle_secret_id        = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.kv_mountpoint            = secret {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.kv_path                  = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.kv_version               = 2 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.namespace                = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.root_token_id            = **** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.ssl_ca_crt_file          = None {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.timeout                  = 60.0 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.use_ssl                  = False {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 22 02:35:32 devstack cinder-volume[82543]: DEBUG oslo_service.backend._eventlet.service [None req-88d9375f-c3c2-4c4b-ad17-e9a912a53b5e None None] ******************************************************************************** {{(pid=82543) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82678) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 22 02:35:32 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 22 02:35:32 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Running cmd (subprocess): mount.quobyte {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:32 devstack quobyte-client[82685]: Reading configuration file: /etc/quobyte/client.cfg
Apr 22 02:35:32 devstack quobyte-client[82685]: Invalid parameters found, error: missing mount point.
Apr 22 02:35:32 devstack quobyte-client[82685]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 22 02:35:32 devstack quobyte-client[82685]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:35:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:32 devstack sudo[82689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:35:32 devstack sudo[82689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:35:33 devstack sudo[82689]: pam_unix(sudo:session): session closed for user root
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.882s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:33 devstack cinder-volume[82678]: INFO cinder.volume.driver [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Driver hasn't implemented _init_vendor_properties()
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.volume.driver [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82678) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_db.sqlalchemy.engines [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82678) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writer thread running {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.db.sqlalchemy.api [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Building query based on filter {{(pid=82678) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82678) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:33 devstack cinder-volume[82678]: INFO cinder.keymgr.migration [None req-27293567-3c36-4b79-a6e7-32038fe1de0c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 22 02:35:33 devstack sudo[82773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:35:33 devstack sudo[82773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:35:33 devstack sudo[82773]: pam_unix(sudo:session): session closed for user root
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.428s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:35:33 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Driver initialization completed successfully.
Apr 22 02:35:33 devstack cinder-volume[82678]: INFO cinder.manager [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Initiating service 3 cleanup
Apr 22 02:35:33 devstack cinder-volume[82678]: INFO cinder.manager [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Service 3 cleanup completed.
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.service [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Creating RPC server for service cinder-volume {{(pid=82678) start /opt/stack/cinder/cinder/service.py:231}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.service [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82678) start /opt/stack/cinder/cinder/service.py:237}}
Apr 22 02:35:33 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:35:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:35:34 devstack sudo[82790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:35:34 devstack sudo[82790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:35:34 devstack sudo[82790]: pam_unix(sudo:session): session closed for user root
Apr 22 02:35:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.412s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:35:34 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-aa9e7d4f-2dfe-4762-a9f7-c97c7c06c5b6 None None] Driver post RPC initialization completed successfully.
Apr 22 02:35:42 devstack cinder-volume[82543]: DEBUG dbcounter [-] [82543] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82543) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:35:43 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=2 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:35:44 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Flow 'volume_create_manager' (9ce4e2c9-3660-41e4-8f1e-bcd9acc9b678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c259af8-f8d3-48f8-968b-d82141a61964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c259af8-f8d3-48f8-968b-d82141a61964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1478967385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c90219b-8c6b-478a-bd5a-e40355efdfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bae755496794a59b06928492cd35415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:36:34Z,use_quota=True,user_id='557cd17759d14617a502a57c178f9982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23503ec7-5b80-4b35-a843-47e2fbe75648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23503ec7-5b80-4b35-a843-47e2fbe75648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bc303b-046e-49f4-a4ee-6323628465b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bc303b-046e-49f4-a4ee-6323628465b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c90219b-8c6b-478a-bd5a-e40355efdfcd', 'volume_name': 'volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27f9200-4768-4a5e-b14f-cba212b59115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e27f9200-4768-4a5e-b14f-cba212b59115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5da722-666a-457b-8778-135ce6283c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:34 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Volume 0c90219b-8c6b-478a-bd5a-e40355efdfcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd', 'volume_size': 1}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1478967385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c90219b-8c6b-478a-bd5a-e40355efdfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bae755496794a59b06928492cd35415',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:36:34Z,use_quota=True,user_id='557cd17759d14617a502a57c178f9982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Creating volume 0c90219b-8c6b-478a-bd5a-e40355efdfcd {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:36:34 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:36:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:36:34 devstack sudo[83275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd 1073741824
Apr 22 02:36:34 devstack sudo[83275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:35 devstack sudo[83275]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd 1073741824" returned: 0 in 0.815s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:36:35 devstack sudo[83593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd
Apr 22 02:36:35 devstack sudo[83593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:35 devstack sudo[83593]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd" returned: 0 in 0.468s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5da722-666a-457b-8778-135ce6283c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092d5422-ce85-4af7-9ed9-5bab3d8a693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:35 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Volume volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd (0c90219b-8c6b-478a-bd5a-e40355efdfcd): created successfully
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (092d5422-ce85-4af7-9ed9-5bab3d8a693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Flow 'volume_create_manager' (9ce4e2c9-3660-41e4-8f1e-bcd9acc9b678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:36:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0af2684b-4d4c-4087-8278-43d6d727de52 tempest-DeleteServersTestJSON-402999534 None] Created volume successfully.
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Flow 'volume_create_manager' (e1c84140-2617-4f49-88b9-b0dc1f6a4223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b3237b-1726-47e5-8b42-62ca3854768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b3237b-1726-47e5-8b42-62ca3854768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1611046910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc57ab98-d219-45c1-8fb2-eb0da5698980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8026e124e77d4757a0b8ea33ca0d8039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:36:43Z,use_quota=True,user_id='6e9922a02cd542a6865476b9defbb193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c53009-859d-481e-9f3d-6b5b8a9c122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c53009-859d-481e-9f3d-6b5b8a9c122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eafe0cb-8f5d-43fe-a8e5-7e5d557c1d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eafe0cb-8f5d-43fe-a8e5-7e5d557c1d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc57ab98-d219-45c1-8fb2-eb0da5698980', 'volume_name': 'volume-fc57ab98-d219-45c1-8fb2-eb0da5698980', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6460f8-7b92-45c4-9d5a-ab9366858315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6460f8-7b92-45c4-9d5a-ab9366858315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b4e292-fb31-4bc3-a72a-778ce76e49e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:43 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Volume fc57ab98-d219-45c1-8fb2-eb0da5698980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc57ab98-d219-45c1-8fb2-eb0da5698980', 'volume_size': 1}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1611046910',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc57ab98-d219-45c1-8fb2-eb0da5698980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8026e124e77d4757a0b8ea33ca0d8039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:36:43Z,use_quota=True,user_id='6e9922a02cd542a6865476b9defbb193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Creating volume fc57ab98-d219-45c1-8fb2-eb0da5698980 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:36:43 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:36:43 devstack sudo[83645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980 1073741824
Apr 22 02:36:43 devstack sudo[83645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:43 devstack cinder-volume[82678]: WARNING py.warnings [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Apr 22 02:36:43 devstack cinder-volume[82678]:   .first()
Apr 22 02:36:43 devstack cinder-volume[82678]: 
Apr 22 02:36:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:36:44 devstack sudo[83645]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980 1073741824" returned: 0 in 1.157s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:36:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:36:44 devstack sudo[83667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980
Apr 22 02:36:44 devstack sudo[83667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:45 devstack sudo[83667]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980" returned: 0 in 0.615s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:36:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:36:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:36:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.499s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:36:45 devstack cinder-volume[82678]: INFO oslo.privsep.daemon [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0ash8kek/privsep.sock']
Apr 22 02:36:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b4e292-fb31-4bc3-a72a-778ce76e49e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc57ab98-d219-45c1-8fb2-eb0da5698980', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac12015c-e2ef-44e0-8c29-3ea51eae2530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:36:45 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Volume volume-fc57ab98-d219-45c1-8fb2-eb0da5698980 (fc57ab98-d219-45c1-8fb2-eb0da5698980): created successfully
Apr 22 02:36:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac12015c-e2ef-44e0-8c29-3ea51eae2530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:36:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Flow 'volume_create_manager' (e1c84140-2617-4f49-88b9-b0dc1f6a4223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:36:45 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5551d800-1b82-4474-86d1-28299f412c82 tempest-VolumesAdminNegativeTest-904210890 None] Created volume successfully.
Apr 22 02:36:45 devstack sudo[83672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0ash8kek/privsep.sock
Apr 22 02:36:45 devstack sudo[83672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 22 02:36:45 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 22 02:36:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Acquiring lock "cinder-fc57ab98-d219-45c1-8fb2-eb0da5698980-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:36:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Lock "cinder-fc57ab98-d219-45c1-8fb2-eb0da5698980-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:36:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Acquiring lock "cinder-quobyte-fc57ab98-d219-45c1-8fb2-eb0da5698980" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 22 02:36:46 devstack cinder-volume[82678]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 22 02:36:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Lock "cinder-quobyte-fc57ab98-d219-45c1-8fb2-eb0da5698980" acquired by "delete_volume" :: waited 0.036s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:36:47 devstack sudo[83672]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:47 devstack cinder-volume[82678]: INFO oslo.privsep.daemon [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] Spawned new privsep daemon via rootwrap
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] Accepted privsep connection to /tmp/tmp0ash8kek/privsep.sock {{(pid=82678) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 22 02:36:47 devstack cinder-volume[82678]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 22 02:36:47 devstack cinder-volume[82678]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 22 02:36:47 devstack cinder-volume[82678]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 22 02:36:47 devstack cinder-volume[82678]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83678
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[64206678-3108-4407-9ba8-98a76bfcea19]: (2,) {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:36:47 devstack cinder-volume[82678]: WARNING oslo_privsep.priv_context [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] privsep daemon already running
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f82de6-abef-453b-9ac6-8be6e7e2250c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2941e1-7c5f-4080-9d61-401a32bd14c7]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:36:47 devstack sudo[83681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd
Apr 22 02:36:47 devstack sudo[83681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:47 devstack sudo[83682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980
Apr 22 02:36:47 devstack sudo[83682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:47 devstack sudo[83681]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd" returned: 0 in 0.682s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.500s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:36:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e', 'name': 'volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ef2c5f7-f2aa-4677-82fc-5b1131941122', 'enforce_multipath': True} {{(pid=82678) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 22 02:36:48 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-0626b8f2-bb34-4c6b-908f-aac690e6c186 req-f61ed230-ae06-4834-a824-89fca45a1af2 tempest-DeleteServersTestJSON-402999534 None] attachment_update completed successfully.
Apr 22 02:36:48 devstack sudo[83682]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980" returned: 0 in 1.678s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:36:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:36:48 devstack sudo[83698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980
Apr 22 02:36:48 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:50 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fc57ab98-d219-45c1-8fb2-eb0da5698980" returned: 0 in 1.481s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Lock "cinder-quobyte-fc57ab98-d219-45c1-8fb2-eb0da5698980" released by "delete_volume" :: held 3.991s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:36:50 devstack cinder-volume[82678]: WARNING cinder.quota [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:36:50 devstack cinder-volume[82678]: WARNING cinder.quota [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Created reservations ['64fd5255-79ed-4fa8-bb36-124859c1d150', 'c350df71-ed28-4781-8a08-2a8a98bdb23f', '6f8c9f46-f06f-40d7-a2c9-96a2f51ee85d', 'd79ab5e2-a43f-43ed-a3ad-081eff3b09ed'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:36:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:36:50 devstack sudo[84096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:36:50 devstack sudo[84096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:36:52 devstack sudo[84096]: pam_unix(sudo:session): session closed for user root
Apr 22 02:36:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 1.419s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:36:52 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:36:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Deleted volume successfully.
Apr 22 02:36:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e00caed-5cdc-424b-aee1-8dc0c5443919 tempest-VolumesAdminNegativeTest-904210890 None] Lock "cinder-fc57ab98-d219-45c1-8fb2-eb0da5698980-delete_volume" released by "delete_volume" :: held 6.028s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:36:59 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-a9a5af69-3121-4fd5-90a9-810726becce6 req-3819ad5f-e1d6-442a-b46d-0fee78c0ba3a tempest-DeleteServersTestJSON-402999534 None] Terminate volume connection completed successfully.
Apr 22 02:36:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-a9a5af69-3121-4fd5-90a9-810726becce6 req-3819ad5f-e1d6-442a-b46d-0fee78c0ba3a tempest-DeleteServersTestJSON-402999534 None] Deleting attachment 0ef2c5f7-f2aa-4677-82fc-5b1131941122. {{(pid=82678) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 22 02:37:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Acquiring lock "cinder-0c90219b-8c6b-478a-bd5a-e40355efdfcd-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Lock "cinder-0c90219b-8c6b-478a-bd5a-e40355efdfcd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Acquiring lock "cinder-quobyte-0c90219b-8c6b-478a-bd5a-e40355efdfcd" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Lock "cinder-quobyte-0c90219b-8c6b-478a-bd5a-e40355efdfcd" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b6fd5-4ba8-4102-a6f4-8c01252ffb8a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:37:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:04 devstack sudo[84373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd
Apr 22 02:37:04 devstack sudo[84373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:05 devstack sudo[84373]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd" returned: 0 in 1.424s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:05 devstack sudo[84381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd
Apr 22 02:37:05 devstack sudo[84381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:06 devstack sudo[84381]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c90219b-8c6b-478a-bd5a-e40355efdfcd" returned: 0 in 0.709s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Lock "cinder-quobyte-0c90219b-8c6b-478a-bd5a-e40355efdfcd" released by "delete_volume" :: held 2.305s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Created reservations ['51efd9da-20ca-4db8-bb06-583505c21821', 'ae74c666-39a3-43ab-b984-256c38ee18b8', 'dfc9994d-56ee-46a1-8a6d-5357ee8175d2', '03d8395e-8351-4c34-9663-ebb5fbd29b1b'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:06 devstack sudo[84391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:37:06 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:07 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.834s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:07 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:37:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Deleted volume successfully.
Apr 22 02:37:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0a49cc73-9096-4365-8b7d-dd8d977790b2 tempest-DeleteServersTestJSON-402999534 None] Lock "cinder-0c90219b-8c6b-478a-bd5a-e40355efdfcd-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Flow 'volume_create_manager' (7da79f2a-4e48-498b-a22c-c44d3a0742f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c85b81-7b7d-4bd5-94fb-7d02cbf9dbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c85b81-7b7d-4bd5-94fb-7d02cbf9dbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1530929997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7030f71-451f-44dd-8539-7076a1abcc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdd762916e43cdafab9b48ed6d94ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:11Z,use_quota=True,user_id='93239d17bdfc4547b467ddb0da3bd625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b197f0c-0524-45c8-b2df-2d125ca6e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b197f0c-0524-45c8-b2df-2d125ca6e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc25b71-09f7-4d88-b56c-f8c4a3cb51e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc25b71-09f7-4d88-b56c-f8c4a3cb51e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7030f71-451f-44dd-8539-7076a1abcc08', 'volume_name': 'volume-e7030f71-451f-44dd-8539-7076a1abcc08', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5568e443-34bf-4628-b81f-de2859cd899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5568e443-34bf-4628-b81f-de2859cd899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ddfcc1-21c9-4b3b-9033-e7a791f5f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:10 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Volume e7030f71-451f-44dd-8539-7076a1abcc08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7030f71-451f-44dd-8539-7076a1abcc08', 'volume_size': 1}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1530929997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7030f71-451f-44dd-8539-7076a1abcc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdd762916e43cdafab9b48ed6d94ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:11Z,use_quota=True,user_id='93239d17bdfc4547b467ddb0da3bd625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Creating volume e7030f71-451f-44dd-8539-7076a1abcc08 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:37:10 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:37:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:10 devstack sudo[84436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08 1073741824
Apr 22 02:37:10 devstack sudo[84436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:12 devstack sudo[84436]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08 1073741824" returned: 0 in 1.307s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:12 devstack sudo[84446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08
Apr 22 02:37:12 devstack sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:13 devstack sudo[84446]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08" returned: 0 in 0.857s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:37:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11ddfcc1-21c9-4b3b-9033-e7a791f5f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7030f71-451f-44dd-8539-7076a1abcc08', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ef0475-edad-4fad-a39c-db62cc8d7ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:13 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Volume volume-e7030f71-451f-44dd-8539-7076a1abcc08 (e7030f71-451f-44dd-8539-7076a1abcc08): created successfully
Apr 22 02:37:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ef0475-edad-4fad-a39c-db62cc8d7ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Flow 'volume_create_manager' (7da79f2a-4e48-498b-a22c-c44d3a0742f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:13 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e3c46975-67e9-486d-87de-515dc30d79a4 tempest-ServersNegativeTestJSON-354213364 None] Created volume successfully.
Apr 22 02:37:17 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Flow 'volume_create_manager' (b75bbf7e-8f48-4150-baa9-09f6b4bb72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26d8d2e-1846-4f92-8600-5ce4cc1b702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26d8d2e-1846-4f92-8600-5ce4cc1b702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1406416117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da1832b-1fd4-446f-b82a-6c61780db10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdd762916e43cdafab9b48ed6d94ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:18Z,use_quota=True,user_id='93239d17bdfc4547b467ddb0da3bd625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6821b416-cad2-430a-9d12-6c34c1f372aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6821b416-cad2-430a-9d12-6c34c1f372aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff09c86e-eb23-4bfe-90e6-62bd23ab0fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff09c86e-eb23-4bfe-90e6-62bd23ab0fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da1832b-1fd4-446f-b82a-6c61780db10b', 'volume_name': 'volume-2da1832b-1fd4-446f-b82a-6c61780db10b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bc010a-6043-43fb-ad6d-98b71e46c27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78bc010a-6043-43fb-ad6d-98b71e46c27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639b989f-ca7f-49e8-8c99-b43b15efb6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:18 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Volume 2da1832b-1fd4-446f-b82a-6c61780db10b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da1832b-1fd4-446f-b82a-6c61780db10b', 'volume_size': 1}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1406416117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da1832b-1fd4-446f-b82a-6c61780db10b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14cdd762916e43cdafab9b48ed6d94ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:18Z,use_quota=True,user_id='93239d17bdfc4547b467ddb0da3bd625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Creating volume 2da1832b-1fd4-446f-b82a-6c61780db10b {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:37:18 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:18 devstack sudo[84524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b 1073741824
Apr 22 02:37:18 devstack sudo[84524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Flow 'volume_create_manager' (fb2638d7-e1b6-4bdf-9c0a-9c896c7104e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff3a065-5898-4158-8f5d-dfd6935e3797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff3a065-5898-4158-8f5d-dfd6935e3797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2071497411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33167721-d943-4eaf-8079-4ed45c641244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79551144b249463784c853631f60088a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:19Z,use_quota=True,user_id='ac347157790e411b9dec8e85daa3dbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a73c092-d87b-49ae-90ca-52ea0c745d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a73c092-d87b-49ae-90ca-52ea0c745d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bbde7f-d922-4230-b7d5-c708b9274812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bbde7f-d922-4230-b7d5-c708b9274812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33167721-d943-4eaf-8079-4ed45c641244', 'volume_name': 'volume-33167721-d943-4eaf-8079-4ed45c641244', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8013fa-a6b9-477e-8549-374a9e8476da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8013fa-a6b9-477e-8549-374a9e8476da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7df5a31-d916-4998-94c5-6c9875791408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:19 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Volume 33167721-d943-4eaf-8079-4ed45c641244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33167721-d943-4eaf-8079-4ed45c641244', 'volume_size': 1}
Apr 22 02:37:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:19 devstack sudo[84524]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b 1073741824" returned: 0 in 1.768s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:20 devstack sudo[84529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b
Apr 22 02:37:20 devstack sudo[84529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:20 devstack sudo[84529]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b" returned: 0 in 0.848s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] <== create_volume: return (2689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.696s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.822s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2071497411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33167721-d943-4eaf-8079-4ed45c641244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79551144b249463784c853631f60088a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:19Z,use_quota=True,user_id='ac347157790e411b9dec8e85daa3dbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Creating volume 33167721-d943-4eaf-8079-4ed45c641244 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:37:20 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639b989f-ca7f-49e8-8c99-b43b15efb6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da1832b-1fd4-446f-b82a-6c61780db10b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d059a58-5c15-42ff-8d28-3f5d8378d681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:20 devstack sudo[84534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244 1073741824
Apr 22 02:37:20 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Volume volume-2da1832b-1fd4-446f-b82a-6c61780db10b (2da1832b-1fd4-446f-b82a-6c61780db10b): created successfully
Apr 22 02:37:20 devstack sudo[84534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d059a58-5c15-42ff-8d28-3f5d8378d681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Flow 'volume_create_manager' (b75bbf7e-8f48-4150-baa9-09f6b4bb72b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:20 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3668bdda-3f41-4c01-bef4-0de61298e633 tempest-ServersNegativeTestJSON-354213364 None] Created volume successfully.
Apr 22 02:37:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "cinder-2da1832b-1fd4-446f-b82a-6c61780db10b-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Lock "cinder-2da1832b-1fd4-446f-b82a-6c61780db10b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "cinder-quobyte-2da1832b-1fd4-446f-b82a-6c61780db10b" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Lock "cinder-quobyte-2da1832b-1fd4-446f-b82a-6c61780db10b" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cbaf2c-26a7-4790-8fac-099fbba85849]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:37:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:22 devstack sudo[84534]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244 1073741824" returned: 0 in 1.700s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:22 devstack sudo[84541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244
Apr 22 02:37:22 devstack sudo[84541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:22 devstack sudo[84540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b
Apr 22 02:37:22 devstack sudo[84540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:23 devstack sudo[84541]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244" returned: 0 in 1.040s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] <== create_volume: return (2798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:37:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.802s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7df5a31-d916-4998-94c5-6c9875791408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33167721-d943-4eaf-8079-4ed45c641244', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5c75e5-e3b4-41bb-aa44-9c7f8181e4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:23 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Volume volume-33167721-d943-4eaf-8079-4ed45c641244 (33167721-d943-4eaf-8079-4ed45c641244): created successfully
Apr 22 02:37:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f5c75e5-e3b4-41bb-aa44-9c7f8181e4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Flow 'volume_create_manager' (fb2638d7-e1b6-4bdf-9c0a-9c896c7104e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:23 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a62a76ce-3da4-4d84-809d-ab997af04e4b tempest-ServerRescueNegativeTestJSON-1791614940 None] Created volume successfully.
Apr 22 02:37:23 devstack sudo[84540]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b" returned: 0 in 1.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:24 devstack sudo[84549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b
Apr 22 02:37:24 devstack sudo[84549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:24 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:UPDATE=32,cinder:SELECT=27,cinder:INSERT=3,cinder:DELETE=4 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:37:24 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-37220696-0fff-43f8-b6eb-3e2783441ffc tempest-GroupSnapshotsV319Test-547829203 None] Group tempest-GroupSnapshotsV319Test-Group-1618799665: creating
Apr 22 02:37:24 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-37220696-0fff-43f8-b6eb-3e2783441ffc tempest-GroupSnapshotsV319Test-547829203 None] Group tempest-GroupSnapshotsV319Test-Group-1618799665: created successfully
Apr 22 02:37:24 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-37220696-0fff-43f8-b6eb-3e2783441ffc tempest-GroupSnapshotsV319Test-547829203 None] Create group completed successfully.
Apr 22 02:37:24 devstack sudo[84549]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da1832b-1fd4-446f-b82a-6c61780db10b" returned: 0 in 0.866s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Lock "cinder-quobyte-2da1832b-1fd4-446f-b82a-6c61780db10b" released by "delete_volume" :: held 2.441s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:24 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Created reservations ['74609db4-02bc-4c81-99f8-5de2dbe2c5d1', 'd3026c3a-8216-410d-987c-3d5825733868', '02f0e8d3-7ac6-481a-8510-089d1251fa7e', '7b76eb1e-f438-4029-ba07-d7802b5fe2f6'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:25 devstack sudo[84553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:37:25 devstack sudo[84553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:25 devstack sudo[84553]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.692s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:37:25 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Deleted volume successfully.
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-529e4baa-3923-49b2-8dfe-43286ba4a24e tempest-ServersNegativeTestJSON-354213364 None] Lock "cinder-2da1832b-1fd4-446f-b82a-6c61780db10b-delete_volume" released by "delete_volume" :: held 3.399s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "cinder-e7030f71-451f-44dd-8539-7076a1abcc08-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Lock "cinder-e7030f71-451f-44dd-8539-7076a1abcc08-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "cinder-quobyte-e7030f71-451f-44dd-8539-7076a1abcc08" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Lock "cinder-quobyte-e7030f71-451f-44dd-8539-7076a1abcc08" acquired by "delete_volume" :: waited 0.028s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[3980a28e-f74d-4c7f-942b-7fc879f3de9a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:26 devstack sudo[84556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08
Apr 22 02:37:26 devstack sudo[84556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Flow 'volume_create_manager' (f10dc2d9-d5c4-4ba6-a5de-ea0095deb21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f447d9f8-1f9e-4ed1-81b5-afaaa6bfd9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f447d9f8-1f9e-4ed1-81b5-afaaa6bfd9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858054716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b3eff83a-3017-48de-bdb2-7c85567259aa,host='devstack@QuobyteHD#QuobyteHD',id=819d6d26-1990-4256-af07-73840b241d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774ae3207637456da601f96ede86b0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:26Z,use_quota=True,user_id='f45f8ce4be0145dc94eebc80b600ff22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bfd0807-3a0e-4723-8552-b6103dbf0517),volume_type_id=5bfd0807-3a0e-4723-8552-b6103dbf0517)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bf0e3c-9ff9-4728-887a-0783c2284e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bf0e3c-9ff9-4728-887a-0783c2284e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be935b4a-56f1-440e-931c-2995ad8954d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be935b4a-56f1-440e-931c-2995ad8954d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819d6d26-1990-4256-af07-73840b241d51', 'volume_name': 'volume-819d6d26-1990-4256-af07-73840b241d51', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a5f86c-801a-430c-8250-9af67039e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a5f86c-801a-430c-8250-9af67039e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae986f8-2bb2-4445-a8f4-472b7324b9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:26 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Volume 819d6d26-1990-4256-af07-73840b241d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819d6d26-1990-4256-af07-73840b241d51', 'volume_size': 1}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b3eff83a-3017-48de-bdb2-7c85567259aa,created_at=2026-04-22T00:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858054716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b3eff83a-3017-48de-bdb2-7c85567259aa,host='devstack@QuobyteHD#QuobyteHD',id=819d6d26-1990-4256-af07-73840b241d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='774ae3207637456da601f96ede86b0c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:26Z,use_quota=True,user_id='f45f8ce4be0145dc94eebc80b600ff22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bfd0807-3a0e-4723-8552-b6103dbf0517),volume_type_id=5bfd0807-3a0e-4723-8552-b6103dbf0517)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Creating volume 819d6d26-1990-4256-af07-73840b241d51 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:37:26 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:37:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:26 devstack sudo[84577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51 1073741824
Apr 22 02:37:26 devstack sudo[84577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:27 devstack sudo[84556]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08" returned: 0 in 1.104s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:27 devstack sudo[84583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08
Apr 22 02:37:27 devstack sudo[84583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:28 devstack sudo[84577]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51 1073741824" returned: 0 in 1.229s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:28 devstack sudo[84588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51
Apr 22 02:37:28 devstack sudo[84588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:28 devstack sudo[84583]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e7030f71-451f-44dd-8539-7076a1abcc08" returned: 0 in 1.275s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Lock "cinder-quobyte-e7030f71-451f-44dd-8539-7076a1abcc08" released by "delete_volume" :: held 2.453s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Created reservations ['0c5a46f9-ed2c-45bf-aef4-4206e2d91bf3', '207fa49e-c9b0-44f2-8c4f-e65bc920374f', '7c42753c-23ee-49ed-a1ae-126000290c57', 'df7a1447-e4ca-4559-8a8f-ac5023759eee'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:28 devstack sudo[84601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:37:28 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:28 devstack sudo[84588]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51" returned: 0 in 0.862s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae986f8-2bb2-4445-a8f4-472b7324b9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819d6d26-1990-4256-af07-73840b241d51', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de49e45-58b7-48c3-a779-e751e33602cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:28 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Volume volume-819d6d26-1990-4256-af07-73840b241d51 (819d6d26-1990-4256-af07-73840b241d51): created successfully
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de49e45-58b7-48c3-a779-e751e33602cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Flow 'volume_create_manager' (f10dc2d9-d5c4-4ba6-a5de-ea0095deb21b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-71f64119-2d21-4adb-b684-6a4f4ca72d43 tempest-GroupSnapshotsV319Test-547829203 None] Created volume successfully.
Apr 22 02:37:29 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:29 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:37:29 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Deleted volume successfully.
Apr 22 02:37:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a6545bf-2136-433b-9207-50c9665ff319 tempest-ServersNegativeTestJSON-354213364 None] Lock "cinder-e7030f71-451f-44dd-8539-7076a1abcc08-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:30 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] GroupSnapshot 949a3dea-879c-4c49-aaa9-12faab341195: creating.
Apr 22 02:37:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Group snapshot 949a3dea-879c-4c49-aaa9-12faab341195: creating. {{(pid=82678) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 22 02:37:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Creating offline snapshot e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 of volume 819d6d26-1990-4256-af07-73840b241d51 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:37:30 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[44095247-30c0-413f-acac-e96874fc7075]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:37:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:30 devstack sudo[84631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51
Apr 22 02:37:30 devstack sudo[84631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:30 devstack sudo[84631]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51" returned: 0 in 0.546s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:30 devstack sudo[84638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 1G
Apr 22 02:37:30 devstack sudo[84638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:31 devstack sudo[84676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:37:31 devstack sudo[84676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:31 devstack sudo[84638]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 1G" returned: 0 in 0.724s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-819d6d26-1990-4256-af07-73840b241d51 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:31 devstack sudo[84678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-819d6d26-1990-4256-af07-73840b241d51 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9
Apr 22 02:37:31 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:31 devstack sudo[84676]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:37:32 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-819d6d26-1990-4256-af07-73840b241d51 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9" returned: 0 in 0.516s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:32 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:37:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:32 devstack sudo[84690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9
Apr 22 02:37:32 devstack sudo[84690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:32 devstack sudo[84690]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9" returned: 0 in 0.407s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:32 devstack sudo[84695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.info
Apr 22 02:37:32 devstack sudo[84695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:32 devstack sudo[84695]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.info" returned: 0 in 0.525s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:32 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:37:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:32 devstack sudo[84700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.info
Apr 22 02:37:32 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:33 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.info" returned: 0 in 0.405s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:33 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-433101f8-54eb-427d-9073-0d7b88023164 tempest-GroupSnapshotsV319Test-547829203 None] group_snapshot 949a3dea-879c-4c49-aaa9-12faab341195: created successfully
Apr 22 02:37:34 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=49,cinder:UPDATE=55,cinder:DELETE=4,cinder:INSERT=18 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:37:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] group_snapshot 949a3dea-879c-4c49-aaa9-12faab341195: deleting
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] group_snapshot 949a3dea-879c-4c49-aaa9-12faab341195: deleting {{(pid=82678) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Acquiring lock "cinder-quobyte-819d6d26-1990-4256-af07-73840b241d51" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Lock "cinder-quobyte-819d6d26-1990-4256-af07-73840b241d51" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Acquiring lock "cinder-quobyte-e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Lock "cinder-quobyte-e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Deleting offline snapshot e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 of volume 819d6d26-1990-4256-af07-73840b241d51 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] snapshot_file for this snap is: volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53c280d-5abc-40c6-b320-7a5198b2c8e0]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:37:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:35 devstack sudo[84732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9
Apr 22 02:37:35 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:36 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9" returned: 0 in 1.563s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-819d6d26-1990-4256-af07-73840b241d51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:37:36 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e603b7-0270-44d6-832a-e1fa2a24adab]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:37:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:37 devstack sudo[84759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51
Apr 22 02:37:37 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:38 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51" returned: 0 in 1.054s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:38 devstack sudo[84785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9
Apr 22 02:37:38 devstack sudo[84785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:38 devstack sudo[84785]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9" returned: 0 in 0.959s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:39 devstack sudo[84795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9
Apr 22 02:37:39 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:39 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51.e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9" returned: 0 in 0.883s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Lock "cinder-quobyte-e6c73159-fe3f-43f2-93fa-ef13a6f3d1d9" released by "_delete_snapshot" :: held 4.603s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Lock "cinder-quobyte-819d6d26-1990-4256-af07-73840b241d51" released by "delete_snapshot" :: held 4.627s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:39 devstack cinder-volume[82678]: WARNING cinder.quota [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1626611902 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1626611902, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:37:39 devstack cinder-volume[82678]: WARNING cinder.quota [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1626611902 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1626611902, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:37:39 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] Created reservations ['0fdaaee4-4fbf-4cf9-a9e4-8be3a388ea5e', '9886a18f-2450-4bc1-9553-bdf5aebf7f77', 'a3b34c3b-a628-466f-8019-9d9a49125aa5', 'fbb6352e-26f7-4f53-9a47-06c5d3d404c7'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:37:40 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-df2dcf24-26d4-4152-9ecf-56c9c2a36f00 tempest-GroupSnapshotsV319Test-547829203 None] group_snapshot 949a3dea-879c-4c49-aaa9-12faab341195: deleted successfully
Apr 22 02:37:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Acquiring lock "cinder-quobyte-819d6d26-1990-4256-af07-73840b241d51" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Lock "cinder-quobyte-819d6d26-1990-4256-af07-73840b241d51" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96ed7eb-d0de-4308-8f01-0f6f6986e12c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:37:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:41 devstack sudo[84872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51
Apr 22 02:37:41 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:42 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51" returned: 0 in 0.734s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:42 devstack sudo[84902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51
Apr 22 02:37:42 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Acquiring lock "cinder-33167721-d943-4eaf-8079-4ed45c641244-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "cinder-33167721-d943-4eaf-8079-4ed45c641244-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Acquiring lock "cinder-quobyte-33167721-d943-4eaf-8079-4ed45c641244" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:37:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "cinder-quobyte-33167721-d943-4eaf-8079-4ed45c641244" acquired by "delete_volume" :: waited 0.039s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dc4635-e838-425a-a02e-ad2af4eadf0b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:43 devstack sudo[84922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244
Apr 22 02:37:43 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:43 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-819d6d26-1990-4256-af07-73840b241d51" returned: 0 in 1.284s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Lock "cinder-quobyte-819d6d26-1990-4256-af07-73840b241d51" released by "delete_volume" :: held 2.096s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Created reservations ['4669ae9f-3910-4c3c-af01-f7cc06e599d0'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:37:43 devstack cinder-volume[82678]: WARNING cinder.quota [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1626611902 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1626611902, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Created reservations ['48236408-923d-4b9b-987b-e1970d7eb863', 'f0e5b9b9-8060-4409-b917-3e58a2149670', 'fc9b17a6-8aed-4618-a7c0-56a81c9baabb', 'de179d5b-f480-4982-beaf-970067e664d4'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:43 devstack sudo[84929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:37:43 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:44 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244" returned: 0 in 1.289s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:44 devstack sudo[84931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244
Apr 22 02:37:44 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:45 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 1.474s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:45 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:37:45 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-558bdb86-e0a2-4f3b-b6c4-10afe0558877 tempest-GroupSnapshotsV319Test-547829203 None] Delete group completed successfully.
Apr 22 02:37:45 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-33167721-d943-4eaf-8079-4ed45c641244" returned: 0 in 1.524s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "cinder-quobyte-33167721-d943-4eaf-8079-4ed45c641244" released by "delete_volume" :: held 2.878s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:45 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Created reservations ['fe6106ba-123c-42e9-8331-ee7023369c00', 'f0d0a709-4a6c-4327-aee9-e6c93c8034c0', '1f2df627-e1f1-4a2a-abea-5f777ff09b03', 'b9b018f0-235f-4bc0-8094-066ca346e040'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:37:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:46 devstack sudo[84936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:37:46 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:47 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 1.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:47 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:37:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Deleted volume successfully.
Apr 22 02:37:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dbb57a47-f7f8-4991-92ab-b8d182a41a64 tempest-ServerRescueNegativeTestJSON-1791614940 None] Lock "cinder-33167721-d943-4eaf-8079-4ed45c641244-delete_volume" released by "delete_volume" :: held 4.799s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:37:56 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=16,cinder:INSERT=7,cinder:UPDATE=24 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:37:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ea873da7-7053-4363-9665-4112b6351467 tempest-GroupsV320Test-2075913425 None] Group tempest-GroupsV320Test-Group-1979109995: creating
Apr 22 02:37:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ea873da7-7053-4363-9665-4112b6351467 tempest-GroupsV320Test-2075913425 None] Group tempest-GroupsV320Test-Group-1979109995: created successfully
Apr 22 02:37:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ea873da7-7053-4363-9665-4112b6351467 tempest-GroupsV320Test-2075913425 None] Create group completed successfully.
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Flow 'volume_create_manager' (82d86dbe-68c3-4b76-bda6-3c8794df7c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab75e74d-3599-4d3c-8731-533d3f719a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab75e74d-3599-4d3c-8731-533d3f719a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-329770241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da163293-2240-4ef6-9477-84a2ab14c7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d889ec1392c34a96b182fe97bf8a8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:58Z,use_quota=True,user_id='fbf936fb6e4a4b97b968ae87fb11260e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244c7f26-9429-49f2-88ea-0958178bc0aa),volume_type_id=244c7f26-9429-49f2-88ea-0958178bc0aa)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f896491b-a429-4ae6-be30-6d3920fd3ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f896491b-a429-4ae6-be30-6d3920fd3ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcace884-5ee3-4467-b3bb-bc45212c71b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcace884-5ee3-4467-b3bb-bc45212c71b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da163293-2240-4ef6-9477-84a2ab14c7d2', 'volume_name': 'volume-da163293-2240-4ef6-9477-84a2ab14c7d2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a4aa24-27e8-403e-8e9e-37ac23645d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a4aa24-27e8-403e-8e9e-37ac23645d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b5cafd-00cd-4bae-927a-96ff8fd91829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:57 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Volume da163293-2240-4ef6-9477-84a2ab14c7d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da163293-2240-4ef6-9477-84a2ab14c7d2', 'volume_size': 1}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:37:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-329770241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da163293-2240-4ef6-9477-84a2ab14c7d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d889ec1392c34a96b182fe97bf8a8d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:37:58Z,use_quota=True,user_id='fbf936fb6e4a4b97b968ae87fb11260e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244c7f26-9429-49f2-88ea-0958178bc0aa),volume_type_id=244c7f26-9429-49f2-88ea-0958178bc0aa)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Creating volume da163293-2240-4ef6-9477-84a2ab14c7d2 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:37:57 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:37:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:57 devstack sudo[85036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2 1073741824
Apr 22 02:37:57 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:58 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2 1073741824" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:58 devstack sudo[85041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2
Apr 22 02:37:58 devstack sudo[85041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Created reservations ['106f1393-f442-4b56-8f1e-20f66a4b78f4'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:37:58 devstack sudo[85043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:37:58 devstack sudo[85043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:37:58 devstack sudo[85041]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2" returned: 0 in 0.539s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b5cafd-00cd-4bae-927a-96ff8fd91829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da163293-2240-4ef6-9477-84a2ab14c7d2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36588767-2e85-4f59-9e57-ff051df65cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:37:58 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Volume volume-da163293-2240-4ef6-9477-84a2ab14c7d2 (da163293-2240-4ef6-9477-84a2ab14c7d2): created successfully
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36588767-2e85-4f59-9e57-ff051df65cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:37:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Flow 'volume_create_manager' (82d86dbe-68c3-4b76-bda6-3c8794df7c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:37:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8072f16a-1b29-4567-b18f-d2920db05754 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Created volume successfully.
Apr 22 02:37:59 devstack sudo[85043]: pam_unix(sudo:session): session closed for user root
Apr 22 02:37:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.449s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:37:59 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:37:59 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ccadf66e-e94b-48e2-8c45-ac8d5794b0a6 tempest-GroupsV320Test-2075913425 None] Delete group completed successfully.
Apr 22 02:38:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:00 devstack sudo[85047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:00 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:00 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.455s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:00 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:00 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0f5ec8b6-85db-4ec9-839a-148c5f93f8b1 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Retype volume completed successfully.
Apr 22 02:38:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Acquiring lock "cinder-da163293-2240-4ef6-9477-84a2ab14c7d2-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "cinder-da163293-2240-4ef6-9477-84a2ab14c7d2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Acquiring lock "cinder-quobyte-da163293-2240-4ef6-9477-84a2ab14c7d2" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "cinder-quobyte-da163293-2240-4ef6-9477-84a2ab14c7d2" acquired by "delete_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:01 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6e5762-3cd9-4be8-8e46-df54ca03da92]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:01 devstack sudo[85051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2
Apr 22 02:38:01 devstack sudo[85051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:02 devstack sudo[85051]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2" returned: 0 in 0.649s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:02 devstack sudo[85056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2
Apr 22 02:38:02 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:02 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Flow 'volume_create_manager' (a48ca38c-88d6-4e94-bee8-e6c646b8630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de78a64e-2c3d-4b48-baaf-23ecd32e881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de78a64e-2c3d-4b48-baaf-23ecd32e881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:03Z,deleted=False,deleted_at=None,display_description='',display_name='d1ecd4c1-cbae-4c1a-9736-c68aee3aaf15-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b0e9a0-de9d-499f-b554-70e547fd2560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24df33486bc0433486dd58fe4baeb0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:03Z,use_quota=True,user_id='95dcb713cc724aa9a6324c4ffd96f3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06409aff-3fa8-4a0e-a485-6a750b7a5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06409aff-3fa8-4a0e-a485-6a750b7a5204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6715e7b7-abaf-4d4d-887e-897e1ca585df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6715e7b7-abaf-4d4d-887e-897e1ca585df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b0e9a0-de9d-499f-b554-70e547fd2560', 'volume_name': 'volume-90b0e9a0-de9d-499f-b554-70e547fd2560', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99859bdd-e0a2-4d78-9b16-5e042dae9ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99859bdd-e0a2-4d78-9b16-5e042dae9ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a017ff47-e3be-4c8c-a6c4-30241a684d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:03 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Volume 90b0e9a0-de9d-499f-b554-70e547fd2560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b0e9a0-de9d-499f-b554-70e547fd2560', 'volume_size': 1}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:03Z,deleted=False,deleted_at=None,display_description='',display_name='d1ecd4c1-cbae-4c1a-9736-c68aee3aaf15-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b0e9a0-de9d-499f-b554-70e547fd2560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24df33486bc0433486dd58fe4baeb0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:03Z,use_quota=True,user_id='95dcb713cc724aa9a6324c4ffd96f3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Creating volume 90b0e9a0-de9d-499f-b554-70e547fd2560 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:03 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:03 devstack sudo[85060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560 1073741824
Apr 22 02:38:03 devstack sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:03 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da163293-2240-4ef6-9477-84a2ab14c7d2" returned: 0 in 0.913s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "cinder-quobyte-da163293-2240-4ef6-9477-84a2ab14c7d2" released by "delete_volume" :: held 1.607s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:03 devstack cinder-volume[82678]: WARNING cinder.quota [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:38:03 devstack cinder-volume[82678]: WARNING cinder.quota [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Created reservations ['f24c4835-2a8a-4c8e-8402-d046600f5a2f', '4731cf07-63e3-401b-a74a-8a15a7265e2c', '5630b414-4cbf-477e-8600-4d3ba046429c', 'e07c8793-0c22-4111-8ba9-f891c1c743dd'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:03 devstack sudo[85063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:03 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:04 devstack sudo[85060]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560 1073741824" returned: 0 in 1.023s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:04 devstack sudo[85070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560
Apr 22 02:38:04 devstack sudo[85070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Flow 'volume_create_manager' (e221bf7b-85c4-4e80-abe4-a830e0ae0f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5c1e4f-86b7-4a5f-85ba-9f045dc1a290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5c1e4f-86b7-4a5f-85ba-9f045dc1a290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-379985877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe20a33-a986-4945-86dc-705fed47f725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a996f731fb654af794e9726e662a141e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:04Z,use_quota=True,user_id='ad1be36b3b86479f99ef2fa3ba3d7fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4937fa88-ba5d-41c4-831c-ef4c2d6eb1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4937fa88-ba5d-41c4-831c-ef4c2d6eb1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa8e661-d6b2-4e97-8452-df854034a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efa8e661-d6b2-4e97-8452-df854034a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe20a33-a986-4945-86dc-705fed47f725', 'volume_name': 'volume-0fe20a33-a986-4945-86dc-705fed47f725', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:04 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc4f9f8-d7a8-407f-98bf-a7057e8beeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc4f9f8-d7a8-407f-98bf-a7057e8beeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faeeb467-2d3f-40f7-b84e-ca5838118871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:04 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Volume 0fe20a33-a986-4945-86dc-705fed47f725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe20a33-a986-4945-86dc-705fed47f725', 'volume_size': 1}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 1.127s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:04 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Deleted volume successfully.
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9b08efad-8ead-4c94-b09e-a38211da13b8 tempest-VolumeRetypeWithoutMigrationTest-1293210024 None] Lock "cinder-da163293-2240-4ef6-9477-84a2ab14c7d2-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:04 devstack sudo[85070]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560" returned: 0 in 0.681s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-379985877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe20a33-a986-4945-86dc-705fed47f725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a996f731fb654af794e9726e662a141e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:04Z,use_quota=True,user_id='ad1be36b3b86479f99ef2fa3ba3d7fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Creating volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:04 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a017ff47-e3be-4c8c-a6c4-30241a684d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b0e9a0-de9d-499f-b554-70e547fd2560', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db5670f-30c3-4cd2-ae01-7fc7915c17bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:04 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Volume volume-90b0e9a0-de9d-499f-b554-70e547fd2560 (90b0e9a0-de9d-499f-b554-70e547fd2560): created successfully
Apr 22 02:38:04 devstack sudo[85074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725 1073741824
Apr 22 02:38:04 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db5670f-30c3-4cd2-ae01-7fc7915c17bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Flow 'volume_create_manager' (a48ca38c-88d6-4e94-bee8-e6c646b8630d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:04 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-822b0054-bd34-4dcf-9058-fdd40261c8f3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Created volume successfully.
Apr 22 02:38:05 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725 1073741824" returned: 0 in 0.633s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:05 devstack sudo[85079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725
Apr 22 02:38:05 devstack sudo[85079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:05 devstack sudo[85079]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725" returned: 0 in 0.511s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:05 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faeeb467-2d3f-40f7-b84e-ca5838118871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe20a33-a986-4945-86dc-705fed47f725', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d94dbf-7c5c-483b-ad9f-1701efb141c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:06 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Volume volume-0fe20a33-a986-4945-86dc-705fed47f725 (0fe20a33-a986-4945-86dc-705fed47f725): created successfully
Apr 22 02:38:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10d94dbf-7c5c-483b-ad9f-1701efb141c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Flow 'volume_create_manager' (e221bf7b-85c4-4e80-abe4-a830e0ae0f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:06 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d986825c-9ba4-44ba-b3ae-74759bef62b6 tempest-SnapshotsActionsTest-518431755 None] Created volume successfully.
Apr 22 02:38:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-6cdb840c-603f-455e-b2cc-5a31305d0910 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-6cdb840c-603f-455e-b2cc-5a31305d0910 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:06 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[77900dc1-fec5-4739-9cea-57f87d4e5398]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-6cdb840c-603f-455e-b2cc-5a31305d0910 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:06 devstack sudo[85092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560
Apr 22 02:38:06 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:07 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-6cdb840c-603f-455e-b2cc-5a31305d0910 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560" returned: 0 in 0.581s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-6cdb840c-603f-455e-b2cc-5a31305d0910 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.619s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.373s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Creating offline snapshot fa0d636f-8301-4f09-95d9-62e2b645643f of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852e06e-bceb-4dd7-b823-b9e99657d014]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-6cdb840c-603f-455e-b2cc-5a31305d0910 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e', 'name': 'volume-90b0e9a0-de9d-499f-b554-70e547fd2560', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b9ef057-e592-4368-b476-a7b9e50c9ed3', 'enforce_multipath': True} {{(pid=82678) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 22 02:38:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-276161a2-92fb-4814-a7de-aedb2a2ac276 req-6cdb840c-603f-455e-b2cc-5a31305d0910 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] attachment_update completed successfully.
Apr 22 02:38:07 devstack sudo[85100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725
Apr 22 02:38:07 devstack sudo[85100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:07 devstack sudo[85100]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725" returned: 0 in 0.780s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:07 devstack sudo[85123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f 1G
Apr 22 02:38:07 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:08 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f 1G" returned: 0 in 0.595s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:08 devstack sudo[85131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:08 devstack sudo[85131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:09 devstack sudo[85131]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.514s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:09 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f is being set with open permissions: ugo+rw
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:09 devstack sudo[85136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:09 devstack sudo[85136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Flow 'volume_create_manager' (13d4d25e-7be8-4006-9f07-1b60d4979034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25947226-41f3-43db-9084-0ead1f2b0d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25947226-41f3-43db-9084-0ead1f2b0d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1973477991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5b0345-14d3-491d-a02b-1b012381b786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e332c4bac5b40d8b520bec9f2910332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:09Z,use_quota=True,user_id='92c08f3a87294bbb81a1452258d1da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdef1ec0-ae63-4cef-8a42-fef3dbede0c7),volume_type_id=cdef1ec0-ae63-4cef-8a42-fef3dbede0c7)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fcb42d-1587-4c75-b926-2aec1ce59d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fcb42d-1587-4c75-b926-2aec1ce59d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043eed0f-ad27-40f6-9fa1-a5c3815c4edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043eed0f-ad27-40f6-9fa1-a5c3815c4edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5b0345-14d3-491d-a02b-1b012381b786', 'volume_name': 'volume-fa5b0345-14d3-491d-a02b-1b012381b786', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a411e86-eed9-4742-a5cf-cf2bd35e7d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a411e86-eed9-4742-a5cf-cf2bd35e7d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00017d85-683f-4133-a655-311a3ce41d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Volume fa5b0345-14d3-491d-a02b-1b012381b786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5b0345-14d3-491d-a02b-1b012381b786', 'volume_size': 1}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Flow 'volume_create_manager' (87224c40-492d-492d-94ad-db261a49c8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:09 devstack sudo[85136]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026cfdd9-e68b-4892-80bb-a6484f527c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026cfdd9-e68b-4892-80bb-a6484f527c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-78676145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943b2747-4731-4341-891a-4cd9cb5be58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a14ae88e6ec4b33b5419a9e34687541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:09Z,use_quota=True,user_id='a028fa6a1adb4fd09c1a91d82f14a267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d233f1-6565-45a4-ae6a-1d8d27eea060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d233f1-6565-45a4-ae6a-1d8d27eea060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774bb331-b732-409e-bad1-3327d609b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774bb331-b732-409e-bad1-3327d609b20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '943b2747-4731-4341-891a-4cd9cb5be58e', 'volume_name': 'volume-943b2747-4731-4341-891a-4cd9cb5be58e', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4068b204-76cd-4dcf-86e4-17f960ad5af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4068b204-76cd-4dcf-86e4-17f960ad5af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e911494-7508-489d-958c-1d80fb3608cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:09 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Volume 943b2747-4731-4341-891a-4cd9cb5be58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-943b2747-4731-4341-891a-4cd9cb5be58e', 'volume_size': 1}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.575s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:09 devstack sudo[85207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.info
Apr 22 02:38:09 devstack sudo[85207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:10 devstack sudo[85207]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.info" returned: 0 in 0.416s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:10 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.info is being set with open permissions: ugo+rw
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:10 devstack sudo[85210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.info
Apr 22 02:38:10 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:10 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.info" returned: 0 in 0.436s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.402s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.960s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1973477991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5b0345-14d3-491d-a02b-1b012381b786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e332c4bac5b40d8b520bec9f2910332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:09Z,use_quota=True,user_id='92c08f3a87294bbb81a1452258d1da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdef1ec0-ae63-4cef-8a42-fef3dbede0c7),volume_type_id=cdef1ec0-ae63-4cef-8a42-fef3dbede0c7)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Creating volume fa5b0345-14d3-491d-a02b-1b012381b786 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:10 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:10 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d155dd11-3f5e-48ad-8874-456ebab3ddeb tempest-SnapshotsActionsTest-518431755 None] Create snapshot completed successfully
Apr 22 02:38:10 devstack sudo[85216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786 1073741824
Apr 22 02:38:10 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:10 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786 1073741824" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:11 devstack sudo[85221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786
Apr 22 02:38:11 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:11 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.911s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-78676145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=943b2747-4731-4341-891a-4cd9cb5be58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a14ae88e6ec4b33b5419a9e34687541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:09Z,use_quota=True,user_id='a028fa6a1adb4fd09c1a91d82f14a267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Creating volume 943b2747-4731-4341-891a-4cd9cb5be58e {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:11 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00017d85-683f-4133-a655-311a3ce41d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5b0345-14d3-491d-a02b-1b012381b786', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6074481f-6269-45a9-a5ef-7bb6340162f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:11 devstack sudo[85224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e 1073741824
Apr 22 02:38:11 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:11 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Volume volume-fa5b0345-14d3-491d-a02b-1b012381b786 (fa5b0345-14d3-491d-a02b-1b012381b786): created successfully
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6074481f-6269-45a9-a5ef-7bb6340162f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Flow 'volume_create_manager' (13d4d25e-7be8-4006-9f07-1b60d4979034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:11 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-de882577-2f5f-48ba-aeaa-4263865bce22 tempest-VolumeTypesAccessTest-1600276586 None] Created volume successfully.
Apr 22 02:38:12 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e 1073741824" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:12 devstack sudo[85557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e
Apr 22 02:38:12 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:12 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e" returned: 0 in 0.581s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.453s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Creating offline snapshot 9eb135b2-e644-4d23-884f-1116bafba537 of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e911494-7508-489d-958c-1d80fb3608cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-943b2747-4731-4341-891a-4cd9cb5be58e', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d050083-119b-4ebd-8f7e-1773a45f3099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f113f-aee6-4f34-af13-39468e02bea4]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:12 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Volume volume-943b2747-4731-4341-891a-4cd9cb5be58e (943b2747-4731-4341-891a-4cd9cb5be58e): created successfully
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d050083-119b-4ebd-8f7e-1773a45f3099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Flow 'volume_create_manager' (87224c40-492d-492d-94ad-db261a49c8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Acquiring lock "cinder-fa5b0345-14d3-491d-a02b-1b012381b786-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:12 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-06894aa6-3c91-45cf-80d8-f119183343f6 req-e1f8408f-bb5f-4aca-99fb-485f6d8af5b5 tempest-VolumesSnapshotsTestJSON-1186510507 None] Created volume successfully.
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Lock "cinder-fa5b0345-14d3-491d-a02b-1b012381b786-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Acquiring lock "cinder-quobyte-fa5b0345-14d3-491d-a02b-1b012381b786" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Lock "cinder-quobyte-fa5b0345-14d3-491d-a02b-1b012381b786" acquired by "delete_volume" :: waited 0.034s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:12 devstack sudo[85577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:12 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f852d54-4b6f-471f-a8c2-f9dda4e3b9ef]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:13 devstack sudo[85582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786
Apr 22 02:38:13 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:13 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.553s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:13 devstack sudo[85588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 1G
Apr 22 02:38:13 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:13 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786" returned: 0 in 0.524s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:13 devstack sudo[85593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786
Apr 22 02:38:13 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:13 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-fa5b0345-14d3-491d-a02b-1b012381b786" returned: 0 in 0.511s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Lock "cinder-quobyte-fa5b0345-14d3-491d-a02b-1b012381b786" released by "delete_volume" :: held 1.124s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:14 devstack cinder-volume[82678]: WARNING cinder.quota [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1081372799 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1081372799, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:38:14 devstack cinder-volume[82678]: WARNING cinder.quota [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1081372799 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1081372799, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:38:14 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 1G" returned: 0 in 0.739s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Created reservations ['029ff186-449a-4916-b3e4-0afc8562f3ea', 'd94adfc4-f40e-484e-bc9c-626ba2da8d2c', 'ed1c4868-5e87-46bf-8310-39fc3a4d9547', 'c1738199-6373-48dc-a1ec-0f66dcf9e0dd'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:14 devstack sudo[85599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537
Apr 22 02:38:14 devstack sudo[85599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:14 devstack sudo[85601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:14 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:14 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.451s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:14 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Deleted volume successfully.
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0e6a9b1a-511b-4edb-b2fa-d9e27ab6d72f tempest-VolumeTypesAccessTest-1600276586 None] Lock "cinder-fa5b0345-14d3-491d-a02b-1b012381b786-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:14 devstack sudo[85599]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537" returned: 0 in 0.554s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:14 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 is being set with open permissions: ugo+rw
Apr 22 02:38:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:14 devstack sudo[85608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537
Apr 22 02:38:14 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:15 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537" returned: 0 in 0.430s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.043s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Creating offline snapshot 803faee7-8842-4fe7-928b-d7833930ae67 of volume 943b2747-4731-4341-891a-4cd9cb5be58e {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b368eabe-7893-4c51-be35-ecbcedff7daf]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:15 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-821cbd78-bd73-48fb-a4ee-e7a5d6884c49 tempest-SnapshotsActionsTest-518431755 None] Create snapshot completed successfully
Apr 22 02:38:15 devstack sudo[85611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e
Apr 22 02:38:15 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-9eb135b2-e644-4d23-884f-1116bafba537-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-9eb135b2-e644-4d23-884f-1116bafba537-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-quobyte-9eb135b2-e644-4d23-884f-1116bafba537" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-9eb135b2-e644-4d23-884f-1116bafba537" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Deleting offline snapshot 9eb135b2-e644-4d23-884f-1116bafba537 of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] snapshot_file for this snap is: volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c143ba6d-fa3c-4838-9340-f9755d50b78c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:15 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e" returned: 0 in 0.671s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:15 devstack sudo[85617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537
Apr 22 02:38:15 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:15 devstack sudo[85618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 1G
Apr 22 02:38:15 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:16 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537" returned: 0 in 0.553s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:16 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d8271e-1c9f-4187-98cd-948d9e522d73]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:16 devstack sudo[85625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:16 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:16 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 1G" returned: 0 in 0.774s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943b2747-4731-4341-891a-4cd9cb5be58e -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:16 devstack sudo[85629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943b2747-4731-4341-891a-4cd9cb5be58e -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67
Apr 22 02:38:16 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:17 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.889s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:17 devstack sudo[85638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537
Apr 22 02:38:17 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:17 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-943b2747-4731-4341-891a-4cd9cb5be58e -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67" returned: 0 in 0.694s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:17 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 is being set with open permissions: ugo+rw
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:17 devstack sudo[85640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67
Apr 22 02:38:17 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:17 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537" returned: 0 in 0.704s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:17 devstack sudo[85680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537
Apr 22 02:38:17 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:17 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67" returned: 0 in 0.604s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:17 devstack sudo[85682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.info
Apr 22 02:38:17 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:18 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.info" returned: 0 in 0.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:18 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.info is being set with open permissions: ugo+rw
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:18 devstack sudo[85685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.info
Apr 22 02:38:18 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:18 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.9eb135b2-e644-4d23-884f-1116bafba537" returned: 0 in 0.747s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-9eb135b2-e644-4d23-884f-1116bafba537" released by "_delete_snapshot" :: held 2.956s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" released by "delete_snapshot" :: held 2.970s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:18 devstack cinder-volume[82678]: WARNING cinder.quota [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Created reservations ['ffb8cf03-9b21-4e76-86e8-b17db65ea01a', '74fa9954-f89d-41aa-86ef-cd745ad0e0fa', 'ac4d7912-1ea7-41d2-b7d0-bd21a10694d1', 'ce9a4e59-7a41-4753-a952-a38f41b185d6'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:18 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Delete snapshot completed successfully.
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3624f5f8-a0d4-45bc-b338-b2a7e8c0d141 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-9eb135b2-e644-4d23-884f-1116bafba537-delete_snapshot" released by "delete_snapshot" :: held 3.062s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:18 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.info" returned: 0 in 0.484s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.818s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:18 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-8ee32f17-f342-4a57-87f7-bee3bf87f14d req-6ed890d3-38c9-4ae6-a627-3fd837bed6ec tempest-VolumesSnapshotsTestJSON-1186510507 None] Create snapshot completed successfully
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Creating offline snapshot a6357087-391a-4ede-b24a-bd9f388bfa84 of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e879c60-9d24-41f3-b3df-9c3da0e928fd]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:19 devstack sudo[85689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:19 devstack sudo[85689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "cinder-803faee7-8842-4fe7-928b-d7833930ae67-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-803faee7-8842-4fe7-928b-d7833930ae67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "cinder-quobyte-943b2747-4731-4341-891a-4cd9cb5be58e" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-quobyte-943b2747-4731-4341-891a-4cd9cb5be58e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "cinder-quobyte-803faee7-8842-4fe7-928b-d7833930ae67" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-quobyte-803faee7-8842-4fe7-928b-d7833930ae67" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Deleting offline snapshot 803faee7-8842-4fe7-928b-d7833930ae67 of volume 943b2747-4731-4341-891a-4cd9cb5be58e {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] snapshot_file for this snap is: volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[91156fae-f91e-4eec-a6e4-c45d5cda68fe]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:19 devstack sudo[85689]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.617s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:19 devstack sudo[85695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 1G
Apr 22 02:38:19 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:19 devstack sudo[85694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67
Apr 22 02:38:19 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:20 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67" returned: 0 in 0.550s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-943b2747-4731-4341-891a-4cd9cb5be58e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6da3398-d8f5-48f7-b45b-0864d3c64068]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:20 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 1G" returned: 0 in 0.583s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:20 devstack sudo[85705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84
Apr 22 02:38:20 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:20 devstack sudo[85704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e
Apr 22 02:38:20 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:20 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84" returned: 0 in 0.618s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:20 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 is being set with open permissions: ugo+rw
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:20 devstack sudo[85737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84
Apr 22 02:38:20 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:20 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e" returned: 0 in 0.760s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:20 devstack sudo[85740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67
Apr 22 02:38:20 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:21 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:21 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-dee959a9-5fd0-4182-a7a3-333020487c9c tempest-SnapshotsActionsTest-518431755 None] Create snapshot completed successfully
Apr 22 02:38:21 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67" returned: 0 in 0.558s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:21 devstack sudo[85746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67
Apr 22 02:38:21 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:22 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e.803faee7-8842-4fe7-928b-d7833930ae67" returned: 0 in 0.547s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-quobyte-803faee7-8842-4fe7-928b-d7833930ae67" released by "_delete_snapshot" :: held 2.512s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-quobyte-943b2747-4731-4341-891a-4cd9cb5be58e" released by "delete_snapshot" :: held 2.525s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.quota [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Created reservations ['092d992d-9ba9-4c17-8436-2f900342b207', 'ea7eca66-9041-4db5-937d-70b26fcdddd2', 'ab366f3b-19f7-4e22-87c4-48ddba54a5f7', '1abc463e-081b-42b5-8759-25e84118e2b4'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-a6357087-391a-4ede-b24a-bd9f388bfa84-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:22 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Delete snapshot completed successfully.
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cf0ad3e-678d-45a5-b7d0-46641ad39484 req-dc99a1f3-89af-456d-b3de-2f9754e02b95 tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-803faee7-8842-4fe7-928b-d7833930ae67-delete_snapshot" released by "delete_snapshot" :: held 2.650s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-a6357087-391a-4ede-b24a-bd9f388bfa84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-quobyte-a6357087-391a-4ede-b24a-bd9f388bfa84" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-a6357087-391a-4ede-b24a-bd9f388bfa84" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Deleting offline snapshot a6357087-391a-4ede-b24a-bd9f388bfa84 of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] snapshot_file for this snap is: volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[df36c587-6029-4e32-821c-2550adbfa109]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:22 devstack sudo[85758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84
Apr 22 02:38:22 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:22 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84" returned: 0 in 0.534s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "cinder-943b2747-4731-4341-891a-4cd9cb5be58e-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[af76e40f-2885-4b4a-ba42-070331a7768a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-943b2747-4731-4341-891a-4cd9cb5be58e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "cinder-quobyte-943b2747-4731-4341-891a-4cd9cb5be58e" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-quobyte-943b2747-4731-4341-891a-4cd9cb5be58e" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cb3914-24c8-40f1-ba39-966954fca89e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:22 devstack sudo[85772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:22 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:22 devstack sudo[85773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e
Apr 22 02:38:22 devstack sudo[85773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:23 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.556s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:23 devstack sudo[85782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84
Apr 22 02:38:23 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:23 devstack sudo[85773]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:23 devstack sudo[85784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e
Apr 22 02:38:23 devstack sudo[85784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Flow 'volume_create_manager' (4755f609-9c1e-4d77-b24a-91852b290167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ccfe0a-c416-4c93-b999-e7e05ffa7e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ccfe0a-c416-4c93-b999-e7e05ffa7e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-757674765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396f0fdb-b414-4059-89a6-c569dcc3ec32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d47def84fc405d966e776539255532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:24Z,use_quota=True,user_id='4fa800b538694304abae55578b82e95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b153087-5e14-4fbe-84bb-64d48c26cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b153087-5e14-4fbe-84bb-64d48c26cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ed5fe7-0fe4-4e86-9a45-b816993b3188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ed5fe7-0fe4-4e86-9a45-b816993b3188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396f0fdb-b414-4059-89a6-c569dcc3ec32', 'volume_name': 'volume-396f0fdb-b414-4059-89a6-c569dcc3ec32', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ac2a24-cb06-49ce-b4e4-1a3756cd4920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38ac2a24-cb06-49ce-b4e4-1a3756cd4920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada7a311-c656-4348-bc59-70ba1dc87195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:23 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Volume 396f0fdb-b414-4059-89a6-c569dcc3ec32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396f0fdb-b414-4059-89a6-c569dcc3ec32', 'volume_size': 1}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-757674765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396f0fdb-b414-4059-89a6-c569dcc3ec32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d47def84fc405d966e776539255532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:24Z,use_quota=True,user_id='4fa800b538694304abae55578b82e95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Creating volume 396f0fdb-b414-4059-89a6-c569dcc3ec32 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:23 devstack sudo[85784]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:23 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-943b2747-4731-4341-891a-4cd9cb5be58e" returned: 0 in 0.463s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-quobyte-943b2747-4731-4341-891a-4cd9cb5be58e" released by "delete_volume" :: held 1.048s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:23 devstack sudo[85790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32 1073741824
Apr 22 02:38:23 devstack sudo[85790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:23 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84" returned: 0 in 0.566s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:23 devstack sudo[85792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84
Apr 22 02:38:23 devstack sudo[85792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:23 devstack cinder-volume[82678]: DEBUG cinder.quota [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Created reservations ['7fcd9ceb-9775-48cf-af7c-77d782e83f7f', 'eb0f7706-ce7c-43ae-b0f2-e363ac37a33d', '10d0f0d1-14fa-4d65-b608-d84bbf18a2a0', '8b848185-091e-4e9d-ab6a-3d1f4a4a68bf'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:24 devstack sudo[85794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:24 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:24 devstack sudo[85792]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.a6357087-391a-4ede-b24a-bd9f388bfa84" returned: 0 in 0.452s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-a6357087-391a-4ede-b24a-bd9f388bfa84" released by "_delete_snapshot" :: held 2.169s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" released by "delete_snapshot" :: held 2.180s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:24 devstack sudo[85790]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32 1073741824" returned: 0 in 0.525s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:24 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.461s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.manager [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:24 devstack sudo[85801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32
Apr 22 02:38:24 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:24 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Deleted volume successfully.
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Created reservations ['c41381f7-59b0-4519-93eb-d916c3370064', 'c795d224-36a2-4ecd-927c-a702865cb5c8', 'c5a38bcc-14c2-4d3d-8907-7023b5f7509b', 'fcea8bdc-a13f-44bf-87cd-56ed4578485e'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-8cab7676-0750-4df5-a8cf-8a6823e038aa req-297e95ff-e05c-4ff0-bc40-39f93d370a8b tempest-VolumesSnapshotsTestJSON-1186510507 None] Lock "cinder-943b2747-4731-4341-891a-4cd9cb5be58e-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:24 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Delete snapshot completed successfully.
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e2520afb-b816-4e09-b7bf-fc6f056645d8 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-a6357087-391a-4ede-b24a-bd9f388bfa84-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:24 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32" returned: 0 in 0.416s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada7a311-c656-4348-bc59-70ba1dc87195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396f0fdb-b414-4059-89a6-c569dcc3ec32', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b626fd-472c-4b0d-8613-0080e04f54ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:UPDATE=136,cinder:SELECT=115,cinder:INSERT=20,cinder:DELETE=7 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:38:24 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Volume volume-396f0fdb-b414-4059-89a6-c569dcc3ec32 (396f0fdb-b414-4059-89a6-c569dcc3ec32): created successfully
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47b626fd-472c-4b0d-8613-0080e04f54ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:24 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Flow 'volume_create_manager' (4755f609-9c1e-4d77-b24a-91852b290167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:24 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a97cbddd-de5e-4c24-bea7-22b6baf805f1 tempest-VolumesListAdminTestJSON-788506834 None] Created volume successfully.
Apr 22 02:38:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Creating offline snapshot b0b70e7f-e2a6-40d5-8668-0682b3d19428 of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:25 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd685400-2a78-4f03-a746-89c6248c0d09]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:25 devstack sudo[85805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:25 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Flow 'volume_create_manager' (1bd16184-3f0a-4acc-8679-68cc0146d26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ab5821-42f6-43aa-a850-fdcf8a0de01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ab5821-42f6-43aa-a850-fdcf8a0de01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705840528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24350a6-5717-4b49-a803-59d77a121f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d47def84fc405d966e776539255532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:26Z,use_quota=True,user_id='4fa800b538694304abae55578b82e95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e98b0d-77a7-4179-afe0-d81420ca3f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e98b0d-77a7-4179-afe0-d81420ca3f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf93615-f0ff-4b42-b576-9fc880ffe78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf93615-f0ff-4b42-b576-9fc880ffe78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24350a6-5717-4b49-a803-59d77a121f5b', 'volume_name': 'volume-b24350a6-5717-4b49-a803-59d77a121f5b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:26 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee22c0f-f912-47b3-8bcc-051fb32b5a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dee22c0f-f912-47b3-8bcc-051fb32b5a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e087c5df-40b4-4195-a4a0-7acc0c4dd96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:26 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Volume b24350a6-5717-4b49-a803-59d77a121f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24350a6-5717-4b49-a803-59d77a121f5b', 'volume_size': 1}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.668s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:26 devstack sudo[85810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 1G
Apr 22 02:38:26 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:27 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 1G" returned: 0 in 0.770s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:27 devstack sudo[85843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428
Apr 22 02:38:27 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:27 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428" returned: 0 in 0.571s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:27 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 is being set with open permissions: ugo+rw
Apr 22 02:38:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:27 devstack sudo[85849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428
Apr 22 02:38:27 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:27 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e7a71fcc-698a-4bd0-9759-df1a63cbebfa tempest-GroupSnapshotsTest-92685635 None] Group tempest-GroupSnapshotsTest-Group-422372128: creating
Apr 22 02:38:27 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e7a71fcc-698a-4bd0-9759-df1a63cbebfa tempest-GroupSnapshotsTest-92685635 None] Group tempest-GroupSnapshotsTest-Group-422372128: created successfully
Apr 22 02:38:27 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e7a71fcc-698a-4bd0-9759-df1a63cbebfa tempest-GroupSnapshotsTest-92685635 None] Create group completed successfully.
Apr 22 02:38:28 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428" returned: 0 in 0.457s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.829s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705840528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24350a6-5717-4b49-a803-59d77a121f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d47def84fc405d966e776539255532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:26Z,use_quota=True,user_id='4fa800b538694304abae55578b82e95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Creating volume b24350a6-5717-4b49-a803-59d77a121f5b {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:28 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-06c8e2da-db64-48e7-9e91-aebdce5dcb2b tempest-SnapshotsActionsTest-518431755 None] Create snapshot completed successfully
Apr 22 02:38:28 devstack sudo[85852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b 1073741824
Apr 22 02:38:28 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:28 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b 1073741824" returned: 0 in 0.530s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:28 devstack sudo[85858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b
Apr 22 02:38:28 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-b0b70e7f-e2a6-40d5-8668-0682b3d19428-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-b0b70e7f-e2a6-40d5-8668-0682b3d19428-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-quobyte-b0b70e7f-e2a6-40d5-8668-0682b3d19428" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-b0b70e7f-e2a6-40d5-8668-0682b3d19428" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Deleting offline snapshot b0b70e7f-e2a6-40d5-8668-0682b3d19428 of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] snapshot_file for this snap is: volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c86cb-4395-4225-ac4c-d8ac1e7a36ed]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:29 devstack sudo[85860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428
Apr 22 02:38:29 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:29 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b" returned: 0 in 0.483s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e087c5df-40b4-4195-a4a0-7acc0c4dd96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24350a6-5717-4b49-a803-59d77a121f5b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d6a972-9830-4500-8ba3-7921c59101fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Volume volume-b24350a6-5717-4b49-a803-59d77a121f5b (b24350a6-5717-4b49-a803-59d77a121f5b): created successfully
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3d6a972-9830-4500-8ba3-7921c59101fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Flow 'volume_create_manager' (1bd16184-3f0a-4acc-8679-68cc0146d26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Flow 'volume_create_manager' (95af4e54-1185-4f72-ae17-a39aa0d8ebdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462c50eb-4e1b-459a-9517-bb4bd2596085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462c50eb-4e1b-459a-9517-bb4bd2596085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656540911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b4293b1f-aa9c-4481-86e2-b39e0b9f39ac,host='devstack@QuobyteHD#QuobyteHD',id=71e916f4-76ba-4132-a86a-9e9361b7a603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350c76b49bc0480a8af205da61bf1f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:29Z,use_quota=True,user_id='9ed1d5076c7e4347a5fbdaa93dc59a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e39949da-1edb-493c-9a90-d01ede985025),volume_type_id=e39949da-1edb-493c-9a90-d01ede985025)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be7e135-9898-4873-96b7-18bf44c1e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2be7e135-9898-4873-96b7-18bf44c1e26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8564e0-2ec2-4404-a7ae-05553c9c41e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae8564e0-2ec2-4404-a7ae-05553c9c41e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e916f4-76ba-4132-a86a-9e9361b7a603', 'volume_name': 'volume-71e916f4-76ba-4132-a86a-9e9361b7a603', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ed9e37-9235-4469-90a3-013c3a64dd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75ed9e37-9235-4469-90a3-013c3a64dd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3cac679-e201-42d0-a956-904829963fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Volume 71e916f4-76ba-4132-a86a-9e9361b7a603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e916f4-76ba-4132-a86a-9e9361b7a603', 'volume_size': 1}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b4293b1f-aa9c-4481-86e2-b39e0b9f39ac,created_at=2026-04-22T00:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656540911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b4293b1f-aa9c-4481-86e2-b39e0b9f39ac,host='devstack@QuobyteHD#QuobyteHD',id=71e916f4-76ba-4132-a86a-9e9361b7a603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350c76b49bc0480a8af205da61bf1f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:29Z,use_quota=True,user_id='9ed1d5076c7e4347a5fbdaa93dc59a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e39949da-1edb-493c-9a90-d01ede985025),volume_type_id=e39949da-1edb-493c-9a90-d01ede985025)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Creating volume 71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:29 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:29 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-75f7b5b4-2bba-4a2a-bf23-96cb7c17f811 tempest-VolumesListAdminTestJSON-788506834 None] Created volume successfully.
Apr 22 02:38:29 devstack sudo[85888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 1073741824
Apr 22 02:38:29 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:29 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428" returned: 0 in 0.574s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f20102-072a-473b-81ab-c463abc2cb20]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:29 devstack sudo[85893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:29 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Flow 'volume_create_manager' (e4faf5e3-ab8a-4c39-ae67-7e8fb757b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9ba609-5060-4ed5-af4b-a0827a6e712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9ba609-5060-4ed5-af4b-a0827a6e712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-293554577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a6b5e2-ca40-41ee-ac1e-50b274b1545d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d47def84fc405d966e776539255532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:30Z,use_quota=True,user_id='4fa800b538694304abae55578b82e95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ccfc2e-bbed-4b6c-88f6-d75a55dbd25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ccfc2e-bbed-4b6c-88f6-d75a55dbd25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8acf452-0225-4375-a72f-3bfda58321dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8acf452-0225-4375-a72f-3bfda58321dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a6b5e2-ca40-41ee-ac1e-50b274b1545d', 'volume_name': 'volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d60fe54-3938-4fba-bf95-c93160fb7d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d60fe54-3938-4fba-bf95-c93160fb7d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c229c8cd-b042-4d7c-bd41-7389abc75e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:29 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Volume f5a6b5e2-ca40-41ee-ac1e-50b274b1545d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d', 'volume_size': 1}
Apr 22 02:38:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:30 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 1073741824" returned: 0 in 0.820s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:30 devstack sudo[85898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603
Apr 22 02:38:30 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:30 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.795s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:30 devstack sudo[85903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428
Apr 22 02:38:30 devstack sudo[85903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:30 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603" returned: 0 in 0.442s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.702s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-293554577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a6b5e2-ca40-41ee-ac1e-50b274b1545d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58d47def84fc405d966e776539255532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:30Z,use_quota=True,user_id='4fa800b538694304abae55578b82e95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Creating volume f5a6b5e2-ca40-41ee-ac1e-50b274b1545d {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:30 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3cac679-e201-42d0-a956-904829963fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e916f4-76ba-4132-a86a-9e9361b7a603', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bd8304-d910-40ca-91df-05833425929b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:30 devstack sudo[85906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d 1073741824
Apr 22 02:38:30 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:30 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Volume volume-71e916f4-76ba-4132-a86a-9e9361b7a603 (71e916f4-76ba-4132-a86a-9e9361b7a603): created successfully
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4bd8304-d910-40ca-91df-05833425929b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Flow 'volume_create_manager' (95af4e54-1185-4f72-ae17-a39aa0d8ebdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:30 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d15ae63c-a383-45c2-b1b0-ea03a1c882b2 tempest-GroupSnapshotsTest-92685635 None] Created volume successfully.
Apr 22 02:38:30 devstack sudo[85903]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:30 devstack sudo[85911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428
Apr 22 02:38:30 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:31 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d 1073741824" returned: 0 in 0.673s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:31 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.b0b70e7f-e2a6-40d5-8668-0682b3d19428" returned: 0 in 0.537s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:31 devstack sudo[85945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d
Apr 22 02:38:31 devstack sudo[85945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-b0b70e7f-e2a6-40d5-8668-0682b3d19428" released by "_delete_snapshot" :: held 2.511s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" released by "delete_snapshot" :: held 2.530s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:31 devstack sudo[85947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:31 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Created reservations ['30b8d335-9a26-4b67-b2fb-4a8f7b05fbc8', 'fb41deae-004c-40b5-8f61-9a26e0c52e00', '1904de52-52d5-41fa-928d-923a96ab8421', '4a91188f-0100-47b5-966b-df6772a8a9aa'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Delete snapshot completed successfully.
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d071820d-1287-4628-856b-425b2f81690b tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-b0b70e7f-e2a6-40d5-8668-0682b3d19428-delete_snapshot" released by "delete_snapshot" :: held 2.661s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] GroupSnapshot f7a36fe0-a94f-4868-a022-4325d70c1ac2: creating.
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Group snapshot f7a36fe0-a94f-4868-a022-4325d70c1ac2: creating. {{(pid=82678) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:31 devstack sudo[85945]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d" returned: 0 in 0.464s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.133s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Creating offline snapshot 2f13dc19-2d52-4f7f-acaf-3a2d850ff400 of volume 71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c229c8cd-b042-4d7c-bd41-7389abc75e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a43a265-2de1-4174-9715-57bec8b9325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f734b1-682f-40b1-ad42-2377475102a5]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:31 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Volume volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d (f5a6b5e2-ca40-41ee-ac1e-50b274b1545d): created successfully
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a43a265-2de1-4174-9715-57bec8b9325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Flow 'volume_create_manager' (e4faf5e3-ab8a-4c39-ae67-7e8fb757b917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-78893ae3-88b3-48cf-87a8-03093f9e6145 tempest-VolumesListAdminTestJSON-788506834 None] Created volume successfully.
Apr 22 02:38:31 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.572s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:32 devstack sudo[85966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603
Apr 22 02:38:32 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:32 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603" returned: 0 in 0.828s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:32 devstack sudo[85981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 1G
Apr 22 02:38:32 devstack sudo[85981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Flow 'volume_create_manager' (70d63142-cb9f-4ff2-8b57-992dadbee18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a8f946-5d8f-45e9-ae8a-705fb7670e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a8f946-5d8f-45e9-ae8a-705fb7670e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f04ccb-32e2-444f-9e45-5847c378a52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda724cee8dc4ccdbf5d2692512169a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:33Z,use_quota=True,user_id='1d16bca1a1ae40698dc546187008757c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdc0265-796c-4507-8b23-acfa4ddf7caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdc0265-796c-4507-8b23-acfa4ddf7caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e26c850-3e6b-4061-8420-e0f01b584682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e26c850-3e6b-4061-8420-e0f01b584682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f04ccb-32e2-444f-9e45-5847c378a52f', 'volume_name': 'volume-c3f04ccb-32e2-444f-9e45-5847c378a52f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82cfce61-fdf7-43ef-9c2b-2359cff3e3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82cfce61-fdf7-43ef-9c2b-2359cff3e3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761cca6c-7554-409c-804d-4a8de6c2ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:32 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Volume c3f04ccb-32e2-444f-9e45-5847c378a52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f04ccb-32e2-444f-9e45-5847c378a52f', 'volume_size': 1}
Apr 22 02:38:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:33 devstack sudo[85981]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 1G" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e916f4-76ba-4132-a86a-9e9361b7a603 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:33 devstack sudo[85986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e916f4-76ba-4132-a86a-9e9361b7a603 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400
Apr 22 02:38:33 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:33 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71e916f4-76ba-4132-a86a-9e9361b7a603 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400" returned: 0 in 0.442s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:33 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:38:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:33 devstack sudo[85992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400
Apr 22 02:38:33 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:34 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400" returned: 0 in 0.453s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:34 devstack sudo[85995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.info
Apr 22 02:38:34 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:34 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.info" returned: 0 in 0.441s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:34 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:38:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:34 devstack sudo[86002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.info
Apr 22 02:38:34 devstack sudo[86002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:35 devstack sudo[86002]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.info" returned: 0 in 0.439s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.196s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.601s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Creating offline snapshot 0bb9cf44-fb38-4561-ae60-0767f627f4d1 of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b61a9e-5f8a-4229-8cdc-8816c5f14f93]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4beb0cc0-83eb-4b94-b82e-10534a031225 tempest-GroupSnapshotsTest-92685635 None] group_snapshot f7a36fe0-a94f-4868-a022-4325d70c1ac2: created successfully
Apr 22 02:38:35 devstack sudo[86007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:35 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:35 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:35 devstack sudo[86012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 1G
Apr 22 02:38:35 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:36 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 1G" returned: 0 in 0.522s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:36 devstack sudo[86017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1
Apr 22 02:38:36 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:36 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1" returned: 0 in 0.439s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:36 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 is being set with open permissions: ugo+rw
Apr 22 02:38:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:36 devstack sudo[86022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1
Apr 22 02:38:36 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:37 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.193s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f04ccb-32e2-444f-9e45-5847c378a52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda724cee8dc4ccdbf5d2692512169a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:33Z,use_quota=True,user_id='1d16bca1a1ae40698dc546187008757c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Creating volume c3f04ccb-32e2-444f-9e45-5847c378a52f {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:37 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:37 devstack sudo[86025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f 1073741824
Apr 22 02:38:37 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:37 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-57c27786-40fa-4488-9257-b743f3b06400 tempest-SnapshotsActionsTest-518431755 None] Create snapshot completed successfully
Apr 22 02:38:37 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f 1073741824" returned: 0 in 0.489s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:37 devstack sudo[86030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f
Apr 22 02:38:37 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-0bb9cf44-fb38-4561-ae60-0767f627f4d1-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-0bb9cf44-fb38-4561-ae60-0767f627f4d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Acquiring lock "cinder-quobyte-0bb9cf44-fb38-4561-ae60-0767f627f4d1" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0bb9cf44-fb38-4561-ae60-0767f627f4d1" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Deleting offline snapshot 0bb9cf44-fb38-4561-ae60-0767f627f4d1 of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] snapshot_file for this snap is: volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7804906-bf09-4dcb-8e31-d8257e5b5315]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:37 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1
Apr 22 02:38:37 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:38 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f" returned: 0 in 0.466s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.250s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-2f13dc19-2d52-4f7f-acaf-3a2d850ff400-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" by "_create_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761cca6c-7554-409c-804d-4a8de6c2ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f04ccb-32e2-444f-9e45-5847c378a52f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fd7bb8-90dc-4f3a-ab81-ca0c9885e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:38 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Volume volume-c3f04ccb-32e2-444f-9e45-5847c378a52f (c3f04ccb-32e2-444f-9e45-5847c378a52f): created successfully
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fd7bb8-90dc-4f3a-ab81-ca0c9885e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Flow 'volume_create_manager' (70d63142-cb9f-4ff2-8b57-992dadbee18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-2f13dc19-2d52-4f7f-acaf-3a2d850ff400-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Creating volume e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0 from snapshot 2f13dc19-2d52-4f7f-acaf-3a2d850ff400 {{(pid=82678) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:38 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9490f6e2-8cae-4655-a6eb-885e6280e98c tempest-VolumesListAdminTestJSON-354538667 None] Created volume successfully.
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] snapshot: 2f13dc19-2d52-4f7f-acaf-3a2d850ff400, volume: e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[6329dad3-631e-45a7-baf4-e8fb6ef2580d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:38 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:38 devstack sudo[86038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400
Apr 22 02:38:38 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bc2bca-5694-4190-9ece-03bc3351d5a1]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:38 devstack sudo[86040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:38 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:38 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400" returned: 0 in 0.466s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71e916f4-76ba-4132-a86a-9e9361b7a603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddcd4c5-3bfe-41fe-bcbd-059d58278d1d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:38 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.484s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:38 devstack sudo[86048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603
Apr 22 02:38:38 devstack sudo[86048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:38 devstack sudo[86049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1
Apr 22 02:38:38 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:39 devstack sudo[86048]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603" returned: 0 in 0.604s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0 not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:39 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Acquiring lock "cinder-c3f04ccb-32e2-444f-9e45-5847c378a52f-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:39 devstack sudo[86058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0
Apr 22 02:38:39 devstack sudo[86058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1" returned: 0 in 0.592s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Lock "cinder-c3f04ccb-32e2-444f-9e45-5847c378a52f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:39 devstack sudo[86060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1
Apr 22 02:38:39 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "cinder-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Acquiring lock "cinder-quobyte-c3f04ccb-32e2-444f-9e45-5847c378a52f" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Lock "cinder-quobyte-c3f04ccb-32e2-444f-9e45-5847c378a52f" acquired by "delete_volume" :: waited 0.028s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81e4498-8530-46d3-801c-956beac56984]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "cinder-quobyte-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-quobyte-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ba986-a720-4dcc-b75a-92b523a1a937]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:39 devstack sudo[86062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f
Apr 22 02:38:39 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:39 devstack sudo[86063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d
Apr 22 02:38:39 devstack sudo[86063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:39 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.0bb9cf44-fb38-4561-ae60-0767f627f4d1" returned: 0 in 0.657s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0bb9cf44-fb38-4561-ae60-0767f627f4d1" released by "_delete_snapshot" :: held 2.312s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" released by "delete_snapshot" :: held 2.323s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:40 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Created reservations ['460a8590-92c7-41f0-b564-2652dff0b608', 'd1671f80-7647-41d0-9db3-42592e7326a9', '83128c7d-83a4-4992-9079-558a2ee490f7', 'f5b10cb1-9d25-4d03-a312-ee288afa0969'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:40 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Delete snapshot completed successfully.
Apr 22 02:38:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fe504f60-cb86-4a2e-b190-7d1941e591f1 tempest-SnapshotsActionsTest-191102042 None] Lock "cinder-0bb9cf44-fb38-4561-ae60-0767f627f4d1-delete_snapshot" released by "delete_snapshot" :: held 2.602s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:40 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f" returned: 0 in 0.915s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:40 devstack sudo[86095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f
Apr 22 02:38:40 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:40 devstack sudo[86063]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d" returned: 0 in 1.241s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:40 devstack sudo[86103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d
Apr 22 02:38:40 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "cinder-fa0d636f-8301-4f09-95d9-62e2b645643f-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-fa0d636f-8301-4f09-95d9-62e2b645643f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "cinder-quobyte-fa0d636f-8301-4f09-95d9-62e2b645643f" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-quobyte-fa0d636f-8301-4f09-95d9-62e2b645643f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Deleting offline snapshot fa0d636f-8301-4f09-95d9-62e2b645643f of volume 0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] snapshot_file for this snap is: volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[170e29a9-63f4-421a-b35a-6d1fef4c4a0b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:42 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c3f04ccb-32e2-444f-9e45-5847c378a52f" returned: 0 in 1.697s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:42 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Lock "cinder-quobyte-c3f04ccb-32e2-444f-9e45-5847c378a52f" released by "delete_volume" :: held 2.645s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d" returned: 0 in 1.351s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:42 devstack sudo[86120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:42 devstack sudo[86120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-quobyte-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d" released by "delete_volume" :: held 2.666s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Created reservations ['a89051f7-f077-4228-a84f-933765dacccd', '2584e44f-0c6c-41ed-add4-9c547ac1d07b', '7f539caa-5bf3-4aa7-933f-6cd598e21899', '59df9e71-071e-46cd-ab07-fa230ec1c615'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Created reservations ['8154af1e-8b97-4100-a1e5-5a50de795a5a', '4446adca-1aa5-4eeb-adb1-a024438050ab', 'f99ca833-e7d2-4fee-97c4-8f4c05b085be', '455648ba-818a-462f-94d5-430f75928655'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:42 devstack sudo[86058]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" returned: 0 in 3.156s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:42 devstack sudo[86128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:42 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8478e6-ebc8-48c3-9f99-24d7f2f4878f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:42 devstack sudo[86130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:42 devstack sudo[86130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:42 devstack sudo[86132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603
Apr 22 02:38:42 devstack sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:42 devstack sudo[86120]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.967s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe20a33-a986-4945-86dc-705fed47f725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acc4195-8752-452a-a9db-08d17e92e1d1]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:42 devstack sudo[86142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725
Apr 22 02:38:42 devstack sudo[86130]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:42 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:42 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Deleted volume successfully.
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c5af1881-f579-49b5-a16b-36b5aa9947f3 tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-f5a6b5e2-ca40-41ee-ac1e-50b274b1545d-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:42 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.572s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:42 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Deleted volume successfully.
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2cce47e6-6037-45b7-90b1-dbcf534c8c2f tempest-VolumesListAdminTestJSON-354538667 None] Lock "cinder-c3f04ccb-32e2-444f-9e45-5847c378a52f-delete_volume" released by "delete_volume" :: held 3.654s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "cinder-b24350a6-5717-4b49-a803-59d77a121f5b-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-b24350a6-5717-4b49-a803-59d77a121f5b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "cinder-quobyte-b24350a6-5717-4b49-a803-59d77a121f5b" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-quobyte-b24350a6-5717-4b49-a803-59d77a121f5b" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[9146c29b-ba6d-4df4-8ed2-707a3b18d3d7]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:43 devstack sudo[86147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b
Apr 22 02:38:43 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:43 devstack sudo[86132]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603" returned: 0 in 0.854s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603, size 1024.00 MB, duration 3.17 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:38:43 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Converted 1024.00 MB image at 323.32 MB/s
Apr 22 02:38:43 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0 is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:43 devstack sudo[86150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0
Apr 22 02:38:43 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:43 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725" returned: 0 in 0.570s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:43 devstack sudo[86155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:43 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:43 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b" returned: 0 in 0.560s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:43 devstack sudo[86160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b
Apr 22 02:38:43 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:43 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" returned: 0 in 0.531s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" released by "_copy_volume_from_snapshot" :: held 5.708s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-2f13dc19-2d52-4f7f-acaf-3a2d850ff400-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" released by "_create_volume_from_snapshot" :: held 5.731s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.761s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:43 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d8b2894a-8ceb-44ca-af9b-bcd015db6099 tempest-GroupSnapshotsTest-92685635 None] Create group from source-snapshot-f7a36fe0-a94f-4868-a022-4325d70c1ac2 completed successfully.
Apr 22 02:38:43 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.532s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:43 devstack sudo[86166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f
Apr 22 02:38:43 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:44 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b24350a6-5717-4b49-a803-59d77a121f5b" returned: 0 in 0.493s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-quobyte-b24350a6-5717-4b49-a803-59d77a121f5b" released by "delete_volume" :: held 1.083s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Created reservations ['c86a3c3f-aeb2-4a08-9b10-f27ea557ca64', 'd3ff56ed-6373-4d5a-b0cb-c6025dda87f6', 'd5652679-0bf5-493e-a577-45b4bacb64e4', 'f6154c17-dbad-41bf-8649-1fb637db5c1d'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:44 devstack sudo[86169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:44 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:44 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725.fa0d636f-8301-4f09-95d9-62e2b645643f" returned: 0 in 0.418s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-quobyte-fa0d636f-8301-4f09-95d9-62e2b645643f" released by "_delete_snapshot" :: held 2.592s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" released by "delete_snapshot" :: held 2.632s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Created reservations ['fd393d7d-4a4c-4b84-876c-046680c78e33', '28ff5f77-4a69-401f-9980-48c2272a363f', '40e90074-2a44-4e54-a1db-5c98308bf1d1', '050ed498-c2fd-4afa-826a-4e9902ef0a69'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:44 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Delete snapshot completed successfully.
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-94db5b1a-3335-4715-b9de-9fcfed79da87 tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-fa0d636f-8301-4f09-95d9-62e2b645643f-delete_snapshot" released by "delete_snapshot" :: held 2.759s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:44 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.463s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:44 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Deleted volume successfully.
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2fdb8d3-6106-467f-b282-4420aa45f76c tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-b24350a6-5717-4b49-a803-59d77a121f5b-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "cinder-0fe20a33-a986-4945-86dc-705fed47f725-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-0fe20a33-a986-4945-86dc-705fed47f725-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[832e9b0e-60ba-437a-902f-d061bd00f6aa]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" acquired by "delete_volume" :: waited 0.021s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9536514-4270-4dac-baf1-b664e76873ff]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:45 devstack sudo[86180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725
Apr 22 02:38:45 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:45 devstack sudo[86181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0
Apr 22 02:38:45 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "cinder-396f0fdb-b414-4059-89a6-c569dcc3ec32-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-396f0fdb-b414-4059-89a6-c569dcc3ec32-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "cinder-quobyte-396f0fdb-b414-4059-89a6-c569dcc3ec32" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-quobyte-396f0fdb-b414-4059-89a6-c569dcc3ec32" acquired by "delete_volume" :: waited 0.020s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[db49680a-6a50-439a-93f2-3e89c3dc4408]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:45 devstack sudo[86184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32
Apr 22 02:38:45 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:45 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725" returned: 0 in 0.521s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:45 devstack sudo[86193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725
Apr 22 02:38:45 devstack sudo[86193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:45 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" returned: 0 in 0.513s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:45 devstack sudo[86195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0
Apr 22 02:38:45 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:45 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:45 devstack sudo[86200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32
Apr 22 02:38:45 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:46 devstack sudo[86193]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0fe20a33-a986-4945-86dc-705fed47f725" returned: 0 in 0.541s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-quobyte-0fe20a33-a986-4945-86dc-705fed47f725" released by "delete_volume" :: held 1.106s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Created reservations ['b0b60dac-1984-4eb7-b3c1-d8bb9f958ef7', 'd2a9e203-5fb0-4e2b-92a7-81b872fa2ff3', '8b9c4ef1-48d8-43b4-9308-80f9834df2ef', 'b60e3966-d97d-4e60-8f6e-9c4d1a870af5'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:46 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" returned: 0 in 0.673s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:46 devstack sudo[86232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-e5b7aa00-2cf3-43ea-aa23-49406c0b9ef0" released by "delete_volume" :: held 1.241s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:46 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['3dc290dd-9372-4ffd-9cdc-d90ec96b3764'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:46 devstack cinder-volume[82678]: WARNING cinder.quota [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-475980554 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-475980554, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:38:46 devstack cinder-volume[82678]: WARNING cinder.quota [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-475980554 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-475980554, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['9d02068a-44e5-401c-a689-826a180f9c48', '77796c4e-5c61-4261-8511-a33b3181e110', 'c38946e6-96b6-413f-abd6-5a990103840d', 'dcc509db-8d18-4599-a58d-1b7237e612cc'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:46 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-396f0fdb-b414-4059-89a6-c569dcc3ec32" returned: 0 in 0.647s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-quobyte-396f0fdb-b414-4059-89a6-c569dcc3ec32" released by "delete_volume" :: held 1.177s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Created reservations ['91a75e31-5908-421d-8f7e-4c051d2ed932', '9391374a-c476-4e42-bda5-86b1789a7d69', '932c33d4-42ca-4999-9c66-cb7ca4ed88d5', '8814b06f-3687-4fda-abf4-029f6fe51aa6'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:46 devstack sudo[86236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:46 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:46 devstack sudo[86240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:46 devstack sudo[86240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:46 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.637s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:46 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Deleted volume successfully.
Apr 22 02:38:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd995e0e-9960-4ff9-994d-8841847001ac tempest-SnapshotsActionsTest-518431755 None] Lock "cinder-0fe20a33-a986-4945-86dc-705fed47f725-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:47 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.596s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-27d12e07-ad0b-4ac7-9f19-7b9b3a9bb002 tempest-GroupSnapshotsTest-92685635 None] Delete group completed successfully.
Apr 22 02:38:47 devstack sudo[86240]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.494s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Deleted volume successfully.
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-578447d7-d871-4728-9515-f55519fec2bc tempest-VolumesListAdminTestJSON-788506834 None] Lock "cinder-396f0fdb-b414-4059-89a6-c569dcc3ec32-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] group_snapshot f7a36fe0-a94f-4868-a022-4325d70c1ac2: deleting
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] group_snapshot f7a36fe0-a94f-4868-a022-4325d70c1ac2: deleting {{(pid=82678) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-71e916f4-76ba-4132-a86a-9e9361b7a603" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-71e916f4-76ba-4132-a86a-9e9361b7a603" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-2f13dc19-2d52-4f7f-acaf-3a2d850ff400" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-2f13dc19-2d52-4f7f-acaf-3a2d850ff400" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Deleting offline snapshot 2f13dc19-2d52-4f7f-acaf-3a2d850ff400 of volume 71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] snapshot_file for this snap is: volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[649f2667-0bc9-4c62-88e6-f42703620a30]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:47 devstack sudo[86246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400
Apr 22 02:38:47 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:48 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400" returned: 0 in 0.591s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71e916f4-76ba-4132-a86a-9e9361b7a603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:48 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[f932a309-0936-408b-8e34-91e2d219f77e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:48 devstack sudo[86251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603
Apr 22 02:38:48 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:48 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603" returned: 0 in 0.853s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:48 devstack sudo[86257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400
Apr 22 02:38:48 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:49 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400" returned: 0 in 0.595s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:49 devstack sudo[86262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400
Apr 22 02:38:49 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:50 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603.2f13dc19-2d52-4f7f-acaf-3a2d850ff400" returned: 0 in 0.564s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-2f13dc19-2d52-4f7f-acaf-3a2d850ff400" released by "_delete_snapshot" :: held 2.752s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-71e916f4-76ba-4132-a86a-9e9361b7a603" released by "delete_snapshot" :: held 2.768s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:50 devstack cinder-volume[82678]: WARNING cinder.quota [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-475980554 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-475980554, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:38:50 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['c48bf8d9-7cb0-48bd-b42f-4c7abf67f34c', '0ccd1025-4d00-4b91-a5ad-7a72e72f9671', '41d661af-213f-4f88-a9bf-c7cd3b8579a9', '917d2cfc-abc1-4c95-9233-d0de74da952b'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:50 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e132a0d3-1288-4a87-a7fd-0a5c2c295698 tempest-GroupSnapshotsTest-92685635 None] group_snapshot f7a36fe0-a94f-4868-a022-4325d70c1ac2: deleted successfully
Apr 22 02:38:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-71e916f4-76ba-4132-a86a-9e9361b7a603" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:38:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-71e916f4-76ba-4132-a86a-9e9361b7a603" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:38:50 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[31be45ea-a6e5-4dad-aa14-39348c0db592]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:51 devstack sudo[86266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603
Apr 22 02:38:51 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Flow 'volume_create_manager' (235367f0-3cb1-450b-a9ce-a2f67cc9250a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fd272e-5e5f-4eed-bae4-88a5bb535fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fd272e-5e5f-4eed-bae4-88a5bb535fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-36860722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c29732-1434-4ca0-b8bf-fe19d8ee467b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea20b29aa5f42f8b6b849399d2861f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:51Z,use_quota=True,user_id='0fedf9b2873f45858b0ee934a5937c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c938f6f8-25a8-42ce-9833-046161152b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c938f6f8-25a8-42ce-9833-046161152b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4134bd93-e715-426d-b910-13ec584c9b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4134bd93-e715-426d-b910-13ec584c9b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c29732-1434-4ca0-b8bf-fe19d8ee467b', 'volume_name': 'volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ae0c8a-4482-4fcb-a453-5031d7e7deeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ae0c8a-4482-4fcb-a453-5031d7e7deeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92bc118-de7e-4b03-9289-0eaa13f24b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:51 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Volume 42c29732-1434-4ca0-b8bf-fe19d8ee467b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b', 'volume_size': 1}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-36860722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c29732-1434-4ca0-b8bf-fe19d8ee467b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea20b29aa5f42f8b6b849399d2861f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:51Z,use_quota=True,user_id='0fedf9b2873f45858b0ee934a5937c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Creating volume 42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:51 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:51 devstack sudo[86268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b 1073741824
Apr 22 02:38:51 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:51 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603" returned: 0 in 0.584s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:51 devstack sudo[86274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603
Apr 22 02:38:51 devstack sudo[86274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:51 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b 1073741824" returned: 0 in 0.547s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:51 devstack sudo[86279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b
Apr 22 02:38:51 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:52 devstack sudo[86274]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-71e916f4-76ba-4132-a86a-9e9361b7a603" returned: 0 in 0.471s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-71e916f4-76ba-4132-a86a-9e9361b7a603" released by "delete_volume" :: held 1.089s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Created reservations ['6dea808c-4a83-4acd-a196-8d3d00655c1c'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:52 devstack cinder-volume[82678]: WARNING cinder.db.sqlalchemy.api [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-475980554']
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Created reservations ['6a1c0fa9-06c9-46af-9798-380b8bc7db6b', 'b09f8dad-45a9-4dc9-861e-939a320d1c42', '8095914d-5dc1-47d3-9548-a3df1dddb33f', 'bf2281f2-aa87-470e-93ca-3bbb4e7f0634'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:52 devstack sudo[86283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:38:52 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:52 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b" returned: 0 in 0.429s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92bc118-de7e-4b03-9289-0eaa13f24b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0fb883-5c5d-47b3-96ad-8e12d2426330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Volume volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b (42c29732-1434-4ca0-b8bf-fe19d8ee467b): created successfully
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d0fb883-5c5d-47b3-96ad-8e12d2426330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Flow 'volume_create_manager' (235367f0-3cb1-450b-a9ce-a2f67cc9250a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-208d0d95-1099-420f-b689-ea9595dcc774 tempest-VolumesDeleteCascade-1649240436 None] Created volume successfully.
Apr 22 02:38:52 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:52 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:38:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-115f264b-dd8d-44f3-8b89-864d98450bfe tempest-GroupSnapshotsTest-92685635 None] Delete group completed successfully.
Apr 22 02:38:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Creating offline snapshot 5380a510-a061-44ff-8c80-978e575535f1 of volume 42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:53 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d7a509-68ff-47bc-9f2b-c01f679e390b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:53 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-62166402-db95-4ef9-9878-214cef3ee887 tempest-GroupSnapshotsTest-92685635 None] Group tempest-GroupSnapshotsTest-Group-44055753: creating
Apr 22 02:38:53 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-62166402-db95-4ef9-9878-214cef3ee887 tempest-GroupSnapshotsTest-92685635 None] Group tempest-GroupSnapshotsTest-Group-44055753: created successfully
Apr 22 02:38:53 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-62166402-db95-4ef9-9878-214cef3ee887 tempest-GroupSnapshotsTest-92685635 None] Create group completed successfully.
Apr 22 02:38:53 devstack sudo[86316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b
Apr 22 02:38:53 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:54 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b" returned: 0 in 0.527s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:54 devstack sudo[86321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 1G
Apr 22 02:38:54 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:54 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 1G" returned: 0 in 0.594s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:54 devstack sudo[86326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1
Apr 22 02:38:54 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:54 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Flow 'volume_create_manager' (632e923c-4069-4849-bcec-7fc30f42ab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b28ab8-14f4-48ec-942a-d6ab5e6942b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b28ab8-14f4-48ec-942a-d6ab5e6942b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-796918348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dde5f364-eee4-47f4-9c39-8971c16536c4,host='devstack@QuobyteHD#QuobyteHD',id=2706408d-0aa2-4db1-9b24-8bae9c06be43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350c76b49bc0480a8af205da61bf1f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:55Z,use_quota=True,user_id='9ed1d5076c7e4347a5fbdaa93dc59a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47ccc5c6-bfa2-4d46-af99-4fa5cc5ca953),volume_type_id=47ccc5c6-bfa2-4d46-af99-4fa5cc5ca953)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fddca72-5a1d-42ec-beba-0d5015fc0576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fddca72-5a1d-42ec-beba-0d5015fc0576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99df735-1060-487c-a348-0ce2b88646dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b99df735-1060-487c-a348-0ce2b88646dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2706408d-0aa2-4db1-9b24-8bae9c06be43', 'volume_name': 'volume-2706408d-0aa2-4db1-9b24-8bae9c06be43', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462c5f86-269d-44a5-b5c9-0d83a5b13602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (462c5f86-269d-44a5-b5c9-0d83a5b13602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738e1824-9722-475f-a5ab-d05ea9c2c883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:55 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Volume 2706408d-0aa2-4db1-9b24-8bae9c06be43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2706408d-0aa2-4db1-9b24-8bae9c06be43', 'volume_size': 1}
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:55 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1" returned: 0 in 0.806s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:55 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 is being set with open permissions: ugo+rw
Apr 22 02:38:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:55 devstack sudo[86331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1
Apr 22 02:38:55 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:56 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1" returned: 0 in 0.679s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:56 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=182,cinder:UPDATE=162,cinder:INSERT=53,cinder:DELETE=15 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:38:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:56 devstack sudo[86334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.info
Apr 22 02:38:56 devstack sudo[86334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:56 devstack sudo[86334]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.info" returned: 0 in 0.519s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:56 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.info is being set with open permissions: ugo+rw
Apr 22 02:38:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:56 devstack sudo[86337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.info
Apr 22 02:38:56 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:57 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.info" returned: 0 in 0.500s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.715s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dde5f364-eee4-47f4-9c39-8971c16536c4,created_at=2026-04-22T00:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-796918348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dde5f364-eee4-47f4-9c39-8971c16536c4,host='devstack@QuobyteHD#QuobyteHD',id=2706408d-0aa2-4db1-9b24-8bae9c06be43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350c76b49bc0480a8af205da61bf1f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:38:55Z,use_quota=True,user_id='9ed1d5076c7e4347a5fbdaa93dc59a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47ccc5c6-bfa2-4d46-af99-4fa5cc5ca953),volume_type_id=47ccc5c6-bfa2-4d46-af99-4fa5cc5ca953)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Creating volume 2706408d-0aa2-4db1-9b24-8bae9c06be43 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:38:57 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:57 devstack sudo[86340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 1073741824
Apr 22 02:38:57 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-648cc719-f2aa-44de-9922-822d44ad0300 tempest-VolumesDeleteCascade-1649240436 None] Create snapshot completed successfully
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:38:57 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 1073741824" returned: 0 in 0.696s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:57 devstack sudo[86345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43
Apr 22 02:38:57 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:58 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.524s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Creating offline snapshot 2d49e6ab-ba45-4dc2-8a98-0487814a6f3d of volume 42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (738e1824-9722-475f-a5ab-d05ea9c2c883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2706408d-0aa2-4db1-9b24-8bae9c06be43', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea258fa-4ad8-4732-b798-36470538c018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f096303-0db6-4a0d-910a-ed27a6864365]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:58 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Volume volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 (2706408d-0aa2-4db1-9b24-8bae9c06be43): created successfully
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea258fa-4ad8-4732-b798-36470538c018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Flow 'volume_create_manager' (632e923c-4069-4849-bcec-7fc30f42ab32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-56b522aa-6258-41c0-8d6d-9ad1d6d2c0e5 tempest-GroupSnapshotsTest-92685635 None] Created volume successfully.
Apr 22 02:38:58 devstack sudo[86352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1
Apr 22 02:38:58 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:59 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1" returned: 0 in 0.645s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:59 devstack sudo[86358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d 1G
Apr 22 02:38:59 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:59 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d 1G" returned: 0 in 0.768s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:38:59 devstack sudo[86363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d
Apr 22 02:38:59 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Flow 'volume_create_manager' (a7783f19-1b9a-4043-a48f-7c32c41a373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0df35e-dd0a-4989-ae01-99804c68ea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb0df35e-dd0a-4989-ae01-99804c68ea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-878397343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dde5f364-eee4-47f4-9c39-8971c16536c4,host='devstack@QuobyteHD#QuobyteHD',id=ecf61902-2463-4b2d-983c-4d81b0d45899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350c76b49bc0480a8af205da61bf1f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:00Z,use_quota=True,user_id='9ed1d5076c7e4347a5fbdaa93dc59a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47ccc5c6-bfa2-4d46-af99-4fa5cc5ca953),volume_type_id=47ccc5c6-bfa2-4d46-af99-4fa5cc5ca953)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7df80a-0929-4ef5-9246-169bd931d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c7df80a-0929-4ef5-9246-169bd931d35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff1e18e-0fe0-4490-8fa2-acda794fad63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff1e18e-0fe0-4490-8fa2-acda794fad63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecf61902-2463-4b2d-983c-4d81b0d45899', 'volume_name': 'volume-ecf61902-2463-4b2d-983c-4d81b0d45899', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788115fc-669e-4231-a720-85b0eca5c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (788115fc-669e-4231-a720-85b0eca5c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f438de1-fdc9-4130-a047-a5d8e942b8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:38:59 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Volume ecf61902-2463-4b2d-983c-4d81b0d45899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecf61902-2463-4b2d-983c-4d81b0d45899', 'volume_size': 1}
Apr 22 02:38:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:00 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d" returned: 0 in 0.447s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:00 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d is being set with open permissions: ugo+rw
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:00 devstack sudo[86368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d
Apr 22 02:39:00 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:00 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d" returned: 0 in 0.454s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=dde5f364-eee4-47f4-9c39-8971c16536c4,created_at=2026-04-22T00:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-878397343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=dde5f364-eee4-47f4-9c39-8971c16536c4,host='devstack@QuobyteHD#QuobyteHD',id=ecf61902-2463-4b2d-983c-4d81b0d45899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350c76b49bc0480a8af205da61bf1f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:00Z,use_quota=True,user_id='9ed1d5076c7e4347a5fbdaa93dc59a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47ccc5c6-bfa2-4d46-af99-4fa5cc5ca953),volume_type_id=47ccc5c6-bfa2-4d46-af99-4fa5cc5ca953)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Creating volume ecf61902-2463-4b2d-983c-4d81b0d45899 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:00 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:00 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f2bf622b-b52b-462a-9824-13488dee9acf tempest-VolumesDeleteCascade-1649240436 None] Create snapshot completed successfully
Apr 22 02:39:00 devstack sudo[86371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899 1073741824
Apr 22 02:39:00 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-42c29732-1434-4ca0-b8bf-fe19d8ee467b-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-42c29732-1434-4ca0-b8bf-fe19d8ee467b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Performing cascade delete. {{(pid=82678) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-2d49e6ab-ba45-4dc2-8a98-0487814a6f3d-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-2d49e6ab-ba45-4dc2-8a98-0487814a6f3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-2d49e6ab-ba45-4dc2-8a98-0487814a6f3d" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-2d49e6ab-ba45-4dc2-8a98-0487814a6f3d" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Deleting offline snapshot 2d49e6ab-ba45-4dc2-8a98-0487814a6f3d of volume 42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] snapshot_file for this snap is: volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a9d2c2-512c-4d0e-b2d2-ed7193e0800a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:01 devstack sudo[86373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d
Apr 22 02:39:01 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:01 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Flow 'volume_create_manager' (159c0777-d4f0-45a5-a099-7483f6287abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46107aca-534a-4ca4-85bf-e2394e1923c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46107aca-534a-4ca4-85bf-e2394e1923c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-841930214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0194e0ae-8a4b-404a-887b-405ad89279d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e9f0b9cbbf47d28acb1fd7267aea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:02Z,use_quota=True,user_id='d14766559f64432c8be2d44e517fcddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d2e9e3-3e60-48fe-ab5c-125f19be7f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d2e9e3-3e60-48fe-ab5c-125f19be7f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5b47ed-7a5c-4a3f-b7a0-23882e45976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5b47ed-7a5c-4a3f-b7a0-23882e45976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0194e0ae-8a4b-404a-887b-405ad89279d4', 'volume_name': 'volume-0194e0ae-8a4b-404a-887b-405ad89279d4', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e330a9e-7022-478c-8170-a990426a5818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e330a9e-7022-478c-8170-a990426a5818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d5c670-eda6-4f71-ac07-c751a6c2292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:01 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Volume 0194e0ae-8a4b-404a-887b-405ad89279d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0194e0ae-8a4b-404a-887b-405ad89279d4', 'volume_size': 1}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899 1073741824" returned: 0 in 0.845s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:01 devstack sudo[86379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899
Apr 22 02:39:01 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:01 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d" returned: 0 in 0.604s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b5bd11-2881-45fe-8416-507fd0637745]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:01 devstack sudo[86384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1
Apr 22 02:39:01 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:02 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899" returned: 0 in 0.443s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-841930214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0194e0ae-8a4b-404a-887b-405ad89279d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e9f0b9cbbf47d28acb1fd7267aea00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:02Z,use_quota=True,user_id='d14766559f64432c8be2d44e517fcddb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Creating volume 0194e0ae-8a4b-404a-887b-405ad89279d4 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:02 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f438de1-fdc9-4130-a047-a5d8e942b8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecf61902-2463-4b2d-983c-4d81b0d45899', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7d58d9-9597-473e-b746-fe9320daed50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:02 devstack sudo[86387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4 1073741824
Apr 22 02:39:02 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:02 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Volume volume-ecf61902-2463-4b2d-983c-4d81b0d45899 (ecf61902-2463-4b2d-983c-4d81b0d45899): created successfully
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7d58d9-9597-473e-b746-fe9320daed50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Flow 'volume_create_manager' (a7783f19-1b9a-4043-a48f-7c32c41a373a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:02 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6ae7add5-a90c-409a-ac65-cf6fe123d4b6 tempest-GroupSnapshotsTest-92685635 None] Created volume successfully.
Apr 22 02:39:02 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:02 devstack sudo[86392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d
Apr 22 02:39:02 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:02 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4 1073741824" returned: 0 in 0.612s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:02 devstack sudo[86397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4
Apr 22 02:39:02 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:02 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d" returned: 0 in 0.607s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:02 devstack sudo[86402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d
Apr 22 02:39:02 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-1245b692-8cc3-4fa2-a3e1-281aae5a124a tempest-GroupSnapshotsTest-92685635 None] Update group completed successfully.
Apr 22 02:39:03 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4" returned: 0 in 0.685s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49d5c670-eda6-4f71-ac07-c751a6c2292d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0194e0ae-8a4b-404a-887b-405ad89279d4', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44557a1-1727-4e64-9e2f-22a48eff1a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:03 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Volume volume-0194e0ae-8a4b-404a-887b-405ad89279d4 (0194e0ae-8a4b-404a-887b-405ad89279d4): created successfully
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44557a1-1727-4e64-9e2f-22a48eff1a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Flow 'volume_create_manager' (159c0777-d4f0-45a5-a099-7483f6287abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-79257f23-d2f4-4efc-81ea-83e92b7064a2 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Created volume successfully.
Apr 22 02:39:03 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.2d49e6ab-ba45-4dc2-8a98-0487814a6f3d" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-2d49e6ab-ba45-4dc2-8a98-0487814a6f3d" released by "_delete_snapshot" :: held 2.312s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" released by "delete_snapshot" :: held 2.327s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Created reservations ['566b5107-789e-4b0a-80f1-e3563898f631', 'b399690d-b8ad-4746-aa78-44211a1f28a1', '0bce0155-cfa3-4d59-86e2-e8098e355766', '7be72177-3953-4925-b2f5-64ce0ec26c9a'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Delete snapshot completed successfully.
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-2d49e6ab-ba45-4dc2-8a98-0487814a6f3d-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-5380a510-a061-44ff-8c80-978e575535f1-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-5380a510-a061-44ff-8c80-978e575535f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-5380a510-a061-44ff-8c80-978e575535f1" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-5380a510-a061-44ff-8c80-978e575535f1" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Deleting offline snapshot 5380a510-a061-44ff-8c80-978e575535f1 of volume 42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] snapshot_file for this snap is: volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[2972bccf-2d27-4eae-923f-254ba2bf9d3e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:03 devstack sudo[86406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1
Apr 22 02:39:03 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:04 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1" returned: 0 in 0.801s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d4bfed-cbcc-4b3e-9b37-2be98500a782]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:04 devstack sudo[86414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b
Apr 22 02:39:04 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Acquiring lock "cinder-0194e0ae-8a4b-404a-887b-405ad89279d4-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:04 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3729d66b-7364-4ce3-8318-6401fcd97ce3 tempest-GroupSnapshotsTest-92685635 None] Update group completed successfully.
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Flow 'volume_create_manager' (a3f3a95a-b2f6-4278-a0ae-e1e5659236c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df579ef7-a5bc-49fd-aa77-625912fc10fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "cinder-0194e0ae-8a4b-404a-887b-405ad89279d4-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df579ef7-a5bc-49fd-aa77-625912fc10fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:05Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d32fa5b-c6d3-4823-a910-128f7a404581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24df33486bc0433486dd58fe4baeb0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:05Z,use_quota=True,user_id='95dcb713cc724aa9a6324c4ffd96f3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1a37ca-5c0e-4cf6-9656-4a6dc3f63f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b1a37ca-5c0e-4cf6-9656-4a6dc3f63f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e517a3a-330b-4461-a18a-4b4bfe874f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.image.glance [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Creating Keystone auth plugin from conf {{(pid=82678) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Acquiring lock "cinder-quobyte-0194e0ae-8a4b-404a-887b-405ad89279d4" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "cinder-quobyte-0194e0ae-8a4b-404a-887b-405ad89279d4" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82ece48-a3f4-4e4a-92da-0ec66c2f2c93]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:04 devstack sudo[86416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4
Apr 22 02:39:04 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e517a3a-330b-4461-a18a-4b4bfe874f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d32fa5b-c6d3-4823-a910-128f7a404581', 'volume_name': 'volume-4d32fa5b-c6d3-4823-a910-128f7a404581', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f697110b010>}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a11230e-2d41-4e6f-bfe6-eb1006685a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a11230e-2d41-4e6f-bfe6-eb1006685a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9c2d4d-e3e2-4e1e-9446-63df2fb110fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:05 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Volume 4d32fa5b-c6d3-4823-a910-128f7a404581: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d32fa5b-c6d3-4823-a910-128f7a404581', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f697110b010>}
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Trying to clone 4d32fa5b-c6d3-4823-a910-128f7a404581 from image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]). {{(pid=82678) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 22 02:39:05 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b" returned: 0 in 0.840s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:05 devstack sudo[86442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1
Apr 22 02:39:05 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 22 02:39:05 devstack cinder-volume[82678]: INFO cinder.image.image_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Image download 20.69 MB at 20.69 MB/s
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab591ae-1a7a-43c7-995f-9560ad1d0614]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:05 devstack sudo[86446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD
Apr 22 02:39:05 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:05 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4" returned: 0 in 0.699s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:05 devstack sudo[86449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4
Apr 22 02:39:05 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:05 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-873ecab9-a338-4e43-bca6-2269b25645a7 tempest-GroupSnapshotsTest-92685635 None] Update group completed successfully.
Apr 22 02:39:05 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1" returned: 0 in 0.547s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:05 devstack sudo[86454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1
Apr 22 02:39:05 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:06 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Temporary image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 is fetched for user 95dcb713cc724aa9a6324c4ffd96f3f0. {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e27ac-0f14-49e6-a9fa-0de381adaa6f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:06 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0194e0ae-8a4b-404a-887b-405ad89279d4" returned: 0 in 0.636s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "cinder-quobyte-0194e0ae-8a4b-404a-887b-405ad89279d4" released by "delete_volume" :: held 1.362s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:06 devstack sudo[86460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD
Apr 22 02:39:06 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Created reservations ['72bc3a9d-bd96-4f21-b8e9-a355f7726f0e', 'd0588a1f-cd71-417b-a74e-6276c1c2d7fe', '4fb79924-7fdc-43c9-a7c4-7fe6338b4228', '6ec0d1a6-0480-4eaf-950e-3bebefcebd98'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:06 devstack sudo[86462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:06 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:06 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b.5380a510-a061-44ff-8c80-978e575535f1" returned: 0 in 0.578s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-5380a510-a061-44ff-8c80-978e575535f1" released by "_delete_snapshot" :: held 2.822s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" released by "delete_snapshot" :: held 2.837s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Created reservations ['98be9c5a-cf3f-4112-a616-ad8ddbaf57a9', '5b8160bb-af21-449b-9283-51e081f58c74', '7086d2be-0147-4b60-8888-162ac8186170', 'a870a260-a1ee-4c0c-bc15-37ec603c15d8'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:06 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Delete snapshot completed successfully.
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-5380a510-a061-44ff-8c80-978e575535f1-delete_snapshot" released by "delete_snapshot" :: held 2.992s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Snapshots deleted, issuing volume delete {{(pid=82678) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc095ec-7be7-4071-a39c-4d6816d716bb]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:06 devstack sudo[86465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b
Apr 22 02:39:06 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:06 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD" returned: 0 in 0.683s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:05Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d32fa5b-c6d3-4823-a910-128f7a404581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24df33486bc0433486dd58fe4baeb0e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:05Z,use_quota=True,user_id='95dcb713cc724aa9a6324c4ffd96f3f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Creating volume 4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:06 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:06 devstack sudo[86471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 1073741824
Apr 22 02:39:06 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:06 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.617s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:06 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Deleted volume successfully.
Apr 22 02:39:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-438bb605-3825-46ff-926b-ccbd38311b69 tempest-VolumeQuotasNegativeTestJSON-1580125583 None] Lock "cinder-0194e0ae-8a4b-404a-887b-405ad89279d4-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-1f72aac0-d8f3-4aa2-9002-5f016a15c7c3 tempest-GroupSnapshotsTest-92685635 None] Update group completed successfully.
Apr 22 02:39:07 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b" returned: 0 in 0.650s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:07 devstack sudo[86480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b
Apr 22 02:39:07 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:07 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 1073741824" returned: 0 in 0.627s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:07 devstack sudo[86484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:07 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:07 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42c29732-1434-4ca0-b8bf-fe19d8ee467b" returned: 0 in 0.660s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-42c29732-1434-4ca0-b8bf-fe19d8ee467b" released by "delete_volume" :: held 1.336s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Created reservations ['fb789531-ea98-4beb-9303-794eab691278', '835a9289-de6d-4f73-8919-29ae69b88c05', '3fc66d18-b727-4fe6-83ed-ad7ab4c779bf', 'ec05ea09-5a67-4102-a04c-96d731e2101c'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:08 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 0 in 0.660s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:08 devstack sudo[86495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Attempting download of a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}])) to volume 4d32fa5b-c6d3-4823-a910-128f7a404581. {{(pid=82678) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 22 02:39:08 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f81cd-780a-4e7a-823d-896c239f4eab]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_486p71wy {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:08 devstack sudo[86497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_486p71wy
Apr 22 02:39:08 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:08 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] GroupSnapshot 018a5fb5-da94-4e9d-9919-2a48187e8492: creating.
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Group snapshot 018a5fb5-da94-4e9d-9919-2a48187e8492: creating. {{(pid=82678) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Creating offline snapshot 80ec103b-687f-4005-9ace-c11a3811dc1d of volume 2706408d-0aa2-4db1-9b24-8bae9c06be43 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e938e08c-7260-43f2-b1a1-7ec94ce51260]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:08 devstack sudo[86499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43
Apr 22 02:39:08 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:08 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.774s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:08 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Deleted volume successfully.
Apr 22 02:39:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-91ed9149-e6f1-45ec-a015-75643419ce62 tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-42c29732-1434-4ca0-b8bf-fe19d8ee467b-delete_volume" released by "delete_volume" :: held 7.846s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:09 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_486p71wy" returned: 0 in 0.837s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_486p71wy {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:09 devstack sudo[86517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_486p71wy
Apr 22 02:39:09 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:09 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43" returned: 0 in 0.838s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:09 devstack sudo[86522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d 1G
Apr 22 02:39:09 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Flow 'volume_create_manager' (c66a6f90-0f73-4a97-b5b7-7655f303dcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7667efdc-a4c0-4c51-b859-0cdfd5f295d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7667efdc-a4c0-4c51-b859-0cdfd5f295d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1449470576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35016509-02e4-44e7-b4da-75adf3ef4bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea20b29aa5f42f8b6b849399d2861f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:09Z,use_quota=True,user_id='0fedf9b2873f45858b0ee934a5937c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee2a5ac-e0ca-47fd-819e-8dc1b5a3933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee2a5ac-e0ca-47fd-819e-8dc1b5a3933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1fe6b8-eec6-4545-96ad-65f3f34bee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1fe6b8-eec6-4545-96ad-65f3f34bee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35016509-02e4-44e7-b4da-75adf3ef4bf2', 'volume_name': 'volume-35016509-02e4-44e7-b4da-75adf3ef4bf2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f0957e-8f5e-4f2e-b1c3-4c8361d5f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f0957e-8f5e-4f2e-b1c3-4c8361d5f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60456c9-5f2c-4950-aabe-3a84c0164cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:09 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Volume 35016509-02e4-44e7-b4da-75adf3ef4bf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35016509-02e4-44e7-b4da-75adf3ef4bf2', 'volume_size': 1}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:09 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_486p71wy" returned: 1 in 0.823s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_486p71wy' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b67592-9fc5-4d62-80e6-52c9173c13e8]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:09 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d 1G" returned: 0 in 0.529s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:10 devstack sudo[86530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d
Apr 22 02:39:10 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:10 devstack sudo[86529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD
Apr 22 02:39:10 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:10 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:10 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 was qcow2, converting to raw {{(pid=82678) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 22 02:39:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:10 devstack sudo[86539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:10 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:10 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d" returned: 0 in 0.556s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:10 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:39:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:10 devstack sudo[86541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d
Apr 22 02:39:10 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:11 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d" returned: 0 in 0.685s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:11 devstack sudo[86556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.info
Apr 22 02:39:11 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:11 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 0 in 1.038s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:11 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_bwp_v8kfdevstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:39:11 devstack cinder-volume[82678]: INFO cinder.image.image_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Converted 112.00 MB image at 107.74 MB/s
Apr 22 02:39:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:11 devstack sudo[86558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 1G
Apr 22 02:39:11 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:11 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.info" returned: 0 in 0.543s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:11 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:39:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:11 devstack sudo[86562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.info
Apr 22 02:39:11 devstack sudo[86562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:12 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 1G" returned: 0 in 0.607s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cd5c2f-ae33-4583-bb03-2775b725bef2]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:12 devstack sudo[86567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:12 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:12 devstack sudo[86562]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.info" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.727s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Creating offline snapshot bd83abbb-60ac-48fb-a3db-6d46b725c30d of volume ecf61902-2463-4b2d-983c-4d81b0d45899 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabcb526-b54d-4fc8-a6c5-7ebe7ddf8ece]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:12 devstack sudo[86570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899
Apr 22 02:39:12 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:12 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 0 in 0.681s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:12 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899" returned: 0 in 0.558s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:12 devstack sudo[86584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d 1G
Apr 22 02:39:12 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:12 devstack sudo[86583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:12 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:13 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 1 in 0.542s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Downloaded image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}])) to volume 4d32fa5b-c6d3-4823-a910-128f7a404581 successfully. {{(pid=82678) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Temporary image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 for user 95dcb713cc724aa9a6324c4ffd96f3f0 is deleted. {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Marking volume 4d32fa5b-c6d3-4823-a910-128f7a404581 as bootable. {{(pid=82678) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Copying metadata from image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 to 4d32fa5b-c6d3-4823-a910-128f7a404581. {{(pid=82678) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Creating volume glance metadata for volume 4d32fa5b-c6d3-4823-a910-128f7a404581 backed by image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82678) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea9c2d4d-e3e2-4e1e-9446-63df2fb110fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d32fa5b-c6d3-4823-a910-128f7a404581', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f697110b010>}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ae93a2-d1e7-44a1-9bc4-78dc172a6514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:13 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Volume volume-4d32fa5b-c6d3-4823-a910-128f7a404581 (4d32fa5b-c6d3-4823-a910-128f7a404581): created successfully
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ae93a2-d1e7-44a1-9bc4-78dc172a6514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Flow 'volume_create_manager' (a3f3a95a-b2f6-4278-a0ae-e1e5659236c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:13 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-0e829dc5-0b40-42a0-8119-a37dcb5ee75b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Created volume successfully.
Apr 22 02:39:13 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d 1G" returned: 0 in 0.671s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf61902-2463-4b2d-983c-4d81b0d45899 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:13 devstack sudo[86595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf61902-2463-4b2d-983c-4d81b0d45899 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d
Apr 22 02:39:13 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:14 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecf61902-2463-4b2d-983c-4d81b0d45899 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:14 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:39:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:14 devstack sudo[86602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d
Apr 22 02:39:14 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:14 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d" returned: 0 in 0.541s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:14 devstack sudo[86611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.info
Apr 22 02:39:14 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:15 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.info" returned: 0 in 0.509s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:15 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:15 devstack sudo[86614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.info
Apr 22 02:39:15 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:15 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.info" returned: 0 in 0.571s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.408s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.189s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1449470576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35016509-02e4-44e7-b4da-75adf3ef4bf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea20b29aa5f42f8b6b849399d2861f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:09Z,use_quota=True,user_id='0fedf9b2873f45858b0ee934a5937c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Creating volume 35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:15 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:15 devstack sudo[86617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 1073741824
Apr 22 02:39:15 devstack sudo[86617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:15 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e31a7412-868c-4669-a203-402b672ac051 tempest-GroupSnapshotsTest-92685635 None] group_snapshot 018a5fb5-da94-4e9d-9919-2a48187e8492: created successfully
Apr 22 02:39:16 devstack sudo[86617]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 1073741824" returned: 0 in 0.570s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:16 devstack sudo[86622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2
Apr 22 02:39:16 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:16 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2" returned: 0 in 0.458s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.551s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60456c9-5f2c-4950-aabe-3a84c0164cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35016509-02e4-44e7-b4da-75adf3ef4bf2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56db69fb-a075-47bc-b144-62408cb07917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c36840-38d4-4dc2-b411-1ab0fbbf031f]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:16 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Volume volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 (35016509-02e4-44e7-b4da-75adf3ef4bf2): created successfully
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56db69fb-a075-47bc-b144-62408cb07917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Flow 'volume_create_manager' (c66a6f90-0f73-4a97-b5b7-7655f303dcfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:16 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f198c21b-cf1a-46ca-89db-6df20c058bbc tempest-VolumesDeleteCascade-1649240436 None] Created volume successfully.
Apr 22 02:39:16 devstack sudo[86625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:16 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:17 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] group_snapshot 018a5fb5-da94-4e9d-9919-2a48187e8492: deleting
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] group_snapshot 018a5fb5-da94-4e9d-9919-2a48187e8492: deleting {{(pid=82678) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-2706408d-0aa2-4db1-9b24-8bae9c06be43" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-2706408d-0aa2-4db1-9b24-8bae9c06be43" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-80ec103b-687f-4005-9ace-c11a3811dc1d" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-80ec103b-687f-4005-9ace-c11a3811dc1d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Deleting offline snapshot 80ec103b-687f-4005-9ace-c11a3811dc1d of volume 2706408d-0aa2-4db1-9b24-8bae9c06be43 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] snapshot_file for this snap is: volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7eb8dc-e8bd-4f58-b7ca-f38d25bc91e6]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:17 devstack sudo[86627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d
Apr 22 02:39:17 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:17 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 0 in 0.724s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:17 devstack sudo[86631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:17 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:17 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d" returned: 0 in 0.617s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2706408d-0aa2-4db1-9b24-8bae9c06be43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0681e2e4-8e3e-4205-aa3a-ea9804462c28]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:18 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 1 in 0.557s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.346s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.960s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:18 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43
Apr 22 02:39:18 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Creating offline snapshot 2f36164d-813d-4c7d-b3e2-99ea371669f9 of volume 35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e', 'name': 'volume-4d32fa5b-c6d3-4823-a910-128f7a404581', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6db1584-bcf6-4fe0-992e-40cc041db7da', 'enforce_multipath': True} {{(pid=82678) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de25760-1802-4ea3-b674-4ecdc587e5ee]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:18 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-5f37778b-6ee3-438b-866d-6a5c3f704875 req-6a26bede-a3fb-4380-89f3-44b598d2914b tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] attachment_update completed successfully.
Apr 22 02:39:18 devstack sudo[86675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2
Apr 22 02:39:18 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Flow 'volume_create_manager' (4ef72116-47ca-431d-abd4-22a1045843a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61654b6c-ac96-43e8-b052-e4fff35c6327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61654b6c-ac96-43e8-b052-e4fff35c6327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-58970926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2a9082-223f-445a-9579-8b1904e616dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8665489d54b06b5896853616d188b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:18Z,use_quota=True,user_id='1b0540769d694da28966b068055668e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42d2e6a-4bb0-4735-b224-c42319e370dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42d2e6a-4bb0-4735-b224-c42319e370dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05390020-f6ba-4f44-9d9a-cae7904df76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05390020-f6ba-4f44-9d9a-cae7904df76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2a9082-223f-445a-9579-8b1904e616dd', 'volume_name': 'volume-da2a9082-223f-445a-9579-8b1904e616dd', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118959be-892c-4f8e-a267-6c88c6cd71a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118959be-892c-4f8e-a267-6c88c6cd71a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48723814-4a99-413d-ba35-a791ae0ada23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:18 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Volume da2a9082-223f-445a-9579-8b1904e616dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2a9082-223f-445a-9579-8b1904e616dd', 'volume_size': 1}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:18 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43" returned: 0 in 0.585s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:18 devstack sudo[86680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d
Apr 22 02:39:18 devstack sudo[86680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:18 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2" returned: 0 in 0.574s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:18 devstack sudo[86685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 1G
Apr 22 02:39:18 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:19 devstack sudo[86680]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d" returned: 0 in 0.460s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:19 devstack sudo[86690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d
Apr 22 02:39:19 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:19 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 1G" returned: 0 in 0.495s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:19 devstack sudo[86696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9
Apr 22 02:39:19 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:19 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43.80ec103b-687f-4005-9ace-c11a3811dc1d" returned: 0 in 0.456s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-80ec103b-687f-4005-9ace-c11a3811dc1d" released by "_delete_snapshot" :: held 2.189s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-2706408d-0aa2-4db1-9b24-8bae9c06be43" released by "delete_snapshot" :: held 2.200s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-ecf61902-2463-4b2d-983c-4d81b0d45899" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-ecf61902-2463-4b2d-983c-4d81b0d45899" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-bd83abbb-60ac-48fb-a3db-6d46b725c30d" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-bd83abbb-60ac-48fb-a3db-6d46b725c30d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Deleting offline snapshot bd83abbb-60ac-48fb-a3db-6d46b725c30d of volume ecf61902-2463-4b2d-983c-4d81b0d45899 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] snapshot_file for this snap is: volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a2f7b4-389d-46a8-a239-f7f508e0874d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:19 devstack sudo[86699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d
Apr 22 02:39:19 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:19 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:19 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 is being set with open permissions: ugo+rw
Apr 22 02:39:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:19 devstack sudo[86704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9
Apr 22 02:39:19 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:20 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d" returned: 0 in 0.472s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecf61902-2463-4b2d-983c-4d81b0d45899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e22b29c-1745-4ea4-9e6d-b62b1e65e09c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:20 devstack sudo[86709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899
Apr 22 02:39:20 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:20 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9" returned: 0 in 0.421s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:20 devstack sudo[86712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.info
Apr 22 02:39:20 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:20 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:20 devstack sudo[86718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d
Apr 22 02:39:20 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:20 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.info" returned: 0 in 0.460s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:20 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.info is being set with open permissions: ugo+rw
Apr 22 02:39:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:20 devstack sudo[86720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.info
Apr 22 02:39:20 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:21 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d" returned: 0 in 0.468s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:21 devstack sudo[86726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d
Apr 22 02:39:21 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:21 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.info" returned: 0 in 0.429s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.687s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-58970926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2a9082-223f-445a-9579-8b1904e616dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8665489d54b06b5896853616d188b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:18Z,use_quota=True,user_id='1b0540769d694da28966b068055668e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Creating volume da2a9082-223f-445a-9579-8b1904e616dd {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:21 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:21 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd 1073741824
Apr 22 02:39:21 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:21 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9fa82d45-5fc8-472c-a462-503e96ac3ad3 tempest-VolumesDeleteCascade-1649240436 None] Create snapshot completed successfully
Apr 22 02:39:21 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899.bd83abbb-60ac-48fb-a3db-6d46b725c30d" returned: 0 in 0.425s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-bd83abbb-60ac-48fb-a3db-6d46b725c30d" released by "_delete_snapshot" :: held 1.914s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-ecf61902-2463-4b2d-983c-4d81b0d45899" released by "delete_snapshot" :: held 1.926s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:21 devstack cinder-volume[82678]: WARNING cinder.quota [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1698706148 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1698706148, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:39:21 devstack cinder-volume[82678]: WARNING cinder.quota [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1698706148 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1698706148, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['f607e472-e0b4-43e6-9881-9db6d43cee9e', 'a1054934-56a3-4ca7-b713-7d03edfd975f', 'a9313f76-70b1-4cb9-9979-91c25e4a0c3e', '8c531365-0963-49f7-9a09-9d609a43f5ee'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['dcb8e813-6428-4aa9-ad57-dfae9b03c996', '07065f9c-29bf-4f8a-be46-f59bb706e153', 'a295df2e-904b-4460-8f8c-0a30e1730e85', '0c00f90c-1b45-4beb-a631-cd23a4f7a6ae'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:21 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd 1073741824" returned: 0 in 0.528s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:21 devstack sudo[86738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd
Apr 22 02:39:21 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:21 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3258e9c2-4616-402d-9369-7adf06465312 tempest-GroupSnapshotsTest-92685635 None] group_snapshot 018a5fb5-da94-4e9d-9919-2a48187e8492: deleted successfully
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Flow 'volume_create_manager' (195444b2-1e61-4256-9f1c-382bdd2faef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0c2dbc-5502-4ccb-a627-1d1fecaf4122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0c2dbc-5502-4ccb-a627-1d1fecaf4122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1083949874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6361e680-5b84-4ba6-8cd2-9381f93f8210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ea20b29aa5f42f8b6b849399d2861f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f36164d-813d-4c7d-b3e2-99ea371669f9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:22Z,use_quota=True,user_id='0fedf9b2873f45858b0ee934a5937c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a437f7cb-3b06-45a9-b80c-e1c6467994a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a437f7cb-3b06-45a9-b80c-e1c6467994a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf73a6a-c77b-4859-b682-5661f80f2fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf73a6a-c77b-4859-b682-5661f80f2fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6361e680-5b84-4ba6-8cd2-9381f93f8210', 'volume_name': 'volume-6361e680-5b84-4ba6-8cd2-9381f93f8210', 'volume_size': 1, 'snapshot_id': '2f36164d-813d-4c7d-b3e2-99ea371669f9'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b81d1e4-bcc4-44c4-b093-3a66a35a78d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b81d1e4-bcc4-44c4-b093-3a66a35a78d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5e6bac-e1ee-450e-9e4d-a9740da2febc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Volume 6361e680-5b84-4ba6-8cd2-9381f93f8210: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6361e680-5b84-4ba6-8cd2-9381f93f8210', 'volume_size': 1, 'snapshot_id': '2f36164d-813d-4c7d-b3e2-99ea371669f9'}
Apr 22 02:39:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:22 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.332s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-2f36164d-813d-4c7d-b3e2-99ea371669f9-6361e680-5b84-4ba6-8cd2-9381f93f8210" by "_create_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48723814-4a99-413d-ba35-a791ae0ada23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2a9082-223f-445a-9579-8b1904e616dd', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7559e664-b707-4d24-972f-25b2286d3244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-2f36164d-813d-4c7d-b3e2-99ea371669f9-6361e680-5b84-4ba6-8cd2-9381f93f8210" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Creating volume 6361e680-5b84-4ba6-8cd2-9381f93f8210 from snapshot 2f36164d-813d-4c7d-b3e2-99ea371669f9 {{(pid=82678) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-6361e680-5b84-4ba6-8cd2-9381f93f8210" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:22 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Volume volume-da2a9082-223f-445a-9579-8b1904e616dd (da2a9082-223f-445a-9579-8b1904e616dd): created successfully
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7559e664-b707-4d24-972f-25b2286d3244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Flow 'volume_create_manager' (4ef72116-47ca-431d-abd4-22a1045843a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-6361e680-5b84-4ba6-8cd2-9381f93f8210" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] snapshot: 2f36164d-813d-4c7d-b3e2-99ea371669f9, volume: 6361e680-5b84-4ba6-8cd2-9381f93f8210,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:39:22 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-fa24780a-4089-4338-becc-cf0522ed1395 tempest-VolumesTransfersV357Test-1181274524 None] Created volume successfully.
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[14958daf-f096-4a99-ab88-98b6ed7c5e79]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:22 devstack sudo[86741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9
Apr 22 02:39:22 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:22 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9" returned: 0 in 0.519s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35016509-02e4-44e7-b4da-75adf3ef4bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed17f16d-a5ae-4ebd-b2b9-c18c4982944e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-2706408d-0aa2-4db1-9b24-8bae9c06be43" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-2706408d-0aa2-4db1-9b24-8bae9c06be43" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:22 devstack sudo[86746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2
Apr 22 02:39:22 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[feae1113-15d9-42a2-ae9f-e4eade2460cb]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:22 devstack sudo[86748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43
Apr 22 02:39:22 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:22 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-137ae9fe-0e65-416a-a20e-dca162bd1d0f tempest-VolumesTransfersV357Test-1717764184 None] Transfer volume completed successfully.
Apr 22 02:39:23 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43" returned: 0 in 0.618s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:23 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2" returned: 0 in 0.741s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:23 devstack sudo[86781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43
Apr 22 02:39:23 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:23 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210 not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:39:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:23 devstack sudo[86783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210
Apr 22 02:39:23 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Acquiring lock "cinder-da2a9082-223f-445a-9579-8b1904e616dd-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Lock "cinder-da2a9082-223f-445a-9579-8b1904e616dd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Acquiring lock "cinder-quobyte-da2a9082-223f-445a-9579-8b1904e616dd" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Lock "cinder-quobyte-da2a9082-223f-445a-9579-8b1904e616dd" acquired by "delete_volume" :: waited 0.018s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a16d8d-6fb7-4640-b8e5-6ff2f4d21db9]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:24 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2706408d-0aa2-4db1-9b24-8bae9c06be43" returned: 0 in 0.685s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-2706408d-0aa2-4db1-9b24-8bae9c06be43" released by "delete_volume" :: held 1.337s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-ecf61902-2463-4b2d-983c-4d81b0d45899" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-ecf61902-2463-4b2d-983c-4d81b0d45899" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c614241-e9fb-44db-9ee4-deb56b40f763]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:24 devstack sudo[86790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd
Apr 22 02:39:24 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:24 devstack sudo[86792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899
Apr 22 02:39:24 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:26 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899" returned: 0 in 2.172s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:26 devstack sudo[86810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899
Apr 22 02:39:26 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:26 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd" returned: 0 in 2.489s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:26 devstack sudo[86812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd
Apr 22 02:39:26 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:27 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210" returned: 0 in 3.761s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[790c9b3c-ceb3-42cd-b94e-8c506b0ad8e1]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:27 devstack sudo[86814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2
Apr 22 02:39:27 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:27 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ecf61902-2463-4b2d-983c-4d81b0d45899" returned: 0 in 1.037s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-ecf61902-2463-4b2d-983c-4d81b0d45899" released by "delete_volume" :: held 3.261s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:UPDATE=181,cinder:SELECT=164,cinder:INSERT=39,cinder:DELETE=10 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['37a0650a-7f7c-4ece-89d2-5acffdbead55'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:27 devstack cinder-volume[82678]: WARNING cinder.quota [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1698706148 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1698706148, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['b02d7007-8ebc-4ea5-93eb-b934615359af', 'de42b88b-1cdd-4416-bc68-3e42234b4c19', '1e0535ef-6988-443b-8896-cf3dee087a8f', '96824539-293e-4eb2-916e-4f9e31d885ec'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['999de3cd-5eba-4cdc-8135-5059cd40b9ea', '8ffec851-d2fb-4eb6-ad9e-f18f1ee7613e', '0fd909e5-3922-47d0-906d-b288ac540ea7', '25f32bc4-dc24-4a3e-ae6c-d5cf46a8ea00'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:27 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da2a9082-223f-445a-9579-8b1904e616dd" returned: 0 in 1.123s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Lock "cinder-quobyte-da2a9082-223f-445a-9579-8b1904e616dd" released by "delete_volume" :: held 3.657s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Created reservations ['d0354bf1-29dc-443e-8256-60ae25c250ac', '83fef669-ca4a-412d-8dea-6723a193fff3', '3a19c06c-ff95-4234-91e2-91d7d62e2077', '9dbf6d12-779b-4047-9609-854419d400de'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:27 devstack sudo[86818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:27 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:27 devstack sudo[86822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:27 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:28 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2" returned: 0 in 0.995s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2, size 1024.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:39:28 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Converted 1024.00 MB image at 272.13 MB/s
Apr 22 02:39:28 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210 is being set with open permissions: ugo+rw
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:28 devstack sudo[86825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210
Apr 22 02:39:28 devstack sudo[86825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-021a2db4-608f-4449-bb9e-2339779d049a tempest-GroupSnapshotsTest-92685635 None] Group tempest-GroupSnapshotsTest-Group-1347224833: creating
Apr 22 02:39:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-021a2db4-608f-4449-bb9e-2339779d049a tempest-GroupSnapshotsTest-92685635 None] Group tempest-GroupSnapshotsTest-Group-1347224833: created successfully
Apr 22 02:39:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-021a2db4-608f-4449-bb9e-2339779d049a tempest-GroupSnapshotsTest-92685635 None] Create group completed successfully.
Apr 22 02:39:28 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.592s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Deleted volume successfully.
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d4eff4ac-6bbf-4b9c-9d8f-e4c5a18b58fd tempest-VolumesTransfersV357Test-1599240676 None] Lock "cinder-da2a9082-223f-445a-9579-8b1904e616dd-delete_volume" released by "delete_volume" :: held 4.540s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:28 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.791s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-73cbb62b-c009-4b50-bec3-2eb59b3a6eb0 tempest-GroupSnapshotsTest-92685635 None] Delete group completed successfully.
Apr 22 02:39:28 devstack sudo[86825]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210" returned: 0 in 0.579s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-6361e680-5b84-4ba6-8cd2-9381f93f8210" released by "_copy_volume_from_snapshot" :: held 6.659s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-2f36164d-813d-4c7d-b3e2-99ea371669f9-6361e680-5b84-4ba6-8cd2-9381f93f8210" released by "_create_volume_from_snapshot" :: held 6.692s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.712s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5e6bac-e1ee-450e-9e4d-a9740da2febc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6361e680-5b84-4ba6-8cd2-9381f93f8210', 'volume_size': 1, 'snapshot_id': '2f36164d-813d-4c7d-b3e2-99ea371669f9'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108d9441-b6fd-4351-8108-08383d0e6ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:28 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Volume volume-6361e680-5b84-4ba6-8cd2-9381f93f8210 (6361e680-5b84-4ba6-8cd2-9381f93f8210): created successfully
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108d9441-b6fd-4351-8108-08383d0e6ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Flow 'volume_create_manager' (195444b2-1e61-4256-9f1c-382bdd2faef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3972fb56-a9cf-43e6-8b17-7cfc11abd4eb tempest-VolumesDeleteCascade-1649240436 None] Created volume successfully.
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Flow 'volume_create_manager' (0e0976ff-db82-42ff-b94e-cacbeb0ef7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1998f25f-83a0-4249-8479-f4465ea25197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1998f25f-83a0-4249-8479-f4465ea25197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-503279845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd10142-3b52-410f-916e-c83131933ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8665489d54b06b5896853616d188b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:29Z,use_quota=True,user_id='1b0540769d694da28966b068055668e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e52c3d-4714-4728-b132-afe8bf1ff1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e52c3d-4714-4728-b132-afe8bf1ff1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24741b0d-00e5-46cf-bec5-912924549a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24741b0d-00e5-46cf-bec5-912924549a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd10142-3b52-410f-916e-c83131933ba7', 'volume_name': 'volume-2fd10142-3b52-410f-916e-c83131933ba7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56b8c5e-99e0-46e9-b809-5fd620901808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56b8c5e-99e0-46e9-b809-5fd620901808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c9a8f6-91e1-45df-b16d-8006a3f6cafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Volume 2fd10142-3b52-410f-916e-c83131933ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd10142-3b52-410f-916e-c83131933ba7', 'volume_size': 1}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-503279845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd10142-3b52-410f-916e-c83131933ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d8665489d54b06b5896853616d188b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:29Z,use_quota=True,user_id='1b0540769d694da28966b068055668e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Creating volume 2fd10142-3b52-410f-916e-c83131933ba7 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:29 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:29 devstack sudo[86831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7 1073741824
Apr 22 02:39:29 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-35016509-02e4-44e7-b4da-75adf3ef4bf2-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-35016509-02e4-44e7-b4da-75adf3ef4bf2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Performing cascade delete. {{(pid=82678) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-2f36164d-813d-4c7d-b3e2-99ea371669f9-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-2f36164d-813d-4c7d-b3e2-99ea371669f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-35016509-02e4-44e7-b4da-75adf3ef4bf2" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-35016509-02e4-44e7-b4da-75adf3ef4bf2" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-2f36164d-813d-4c7d-b3e2-99ea371669f9" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-2f36164d-813d-4c7d-b3e2-99ea371669f9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Deleting offline snapshot 2f36164d-813d-4c7d-b3e2-99ea371669f9 of volume 35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] snapshot_file for this snap is: volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[067109d4-0496-4ca4-8a59-53bd03feab8f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:29 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Flow 'volume_create_manager' (7de3a734-c1f4-46a8-8413-1027283b66d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8d31de-0706-45da-925c-f7bb749a7490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7 1073741824" returned: 0 in 0.847s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8d31de-0706-45da-925c-f7bb749a7490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-441818422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c9b5ebc7-c75e-44fd-ba75-ad99f482cd7a,host='devstack@QuobyteHD#QuobyteHD',id=d3551a81-6a0e-4c38-b89a-8dec5a587b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350c76b49bc0480a8af205da61bf1f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:30Z,use_quota=True,user_id='9ed1d5076c7e4347a5fbdaa93dc59a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b24292cf-263e-4996-9917-6303cf6940eb),volume_type_id=b24292cf-263e-4996-9917-6303cf6940eb)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bf867b-5cbd-4c91-ae57-241965fb578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bf867b-5cbd-4c91-ae57-241965fb578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:29 devstack sudo[86836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9
Apr 22 02:39:29 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f39b43e-b790-4ae5-9b02-2e9db491e4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f39b43e-b790-4ae5-9b02-2e9db491e4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3551a81-6a0e-4c38-b89a-8dec5a587b52', 'volume_name': 'volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282758f1-d1ee-43a6-bf98-a3048c061842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282758f1-d1ee-43a6-bf98-a3048c061842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5001bd9e-4bfe-4d7b-bcaf-6833b5ec350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:29 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Volume d3551a81-6a0e-4c38-b89a-8dec5a587b52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52', 'volume_size': 1}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:30 devstack sudo[86838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7
Apr 22 02:39:30 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:30 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9" returned: 0 in 0.576s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35016509-02e4-44e7-b4da-75adf3ef4bf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f286fe-f754-4137-bb99-56b971f35c97]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:30 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7" returned: 0 in 0.462s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c9b5ebc7-c75e-44fd-ba75-ad99f482cd7a,created_at=2026-04-22T00:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-441818422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c9b5ebc7-c75e-44fd-ba75-ad99f482cd7a,host='devstack@QuobyteHD#QuobyteHD',id=d3551a81-6a0e-4c38-b89a-8dec5a587b52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='350c76b49bc0480a8af205da61bf1f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:30Z,use_quota=True,user_id='9ed1d5076c7e4347a5fbdaa93dc59a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b24292cf-263e-4996-9917-6303cf6940eb),volume_type_id=b24292cf-263e-4996-9917-6303cf6940eb)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Creating volume d3551a81-6a0e-4c38-b89a-8dec5a587b52 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:30 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c9a8f6-91e1-45df-b16d-8006a3f6cafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd10142-3b52-410f-916e-c83131933ba7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:30 devstack sudo[86844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2
Apr 22 02:39:30 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:30 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 1073741824
Apr 22 02:39:30 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bebe991-8924-4a99-84a1-cc42e1ccfe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:30 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Volume volume-2fd10142-3b52-410f-916e-c83131933ba7 (2fd10142-3b52-410f-916e-c83131933ba7): created successfully
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bebe991-8924-4a99-84a1-cc42e1ccfe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Flow 'volume_create_manager' (0e0976ff-db82-42ff-b94e-cacbeb0ef7ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:30 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6ff22957-d7c4-4c0f-be9c-45a25f8ecffc tempest-VolumesTransfersV357Test-1181274524 None] Created volume successfully.
Apr 22 02:39:30 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2" returned: 0 in 0.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:30 devstack sudo[86854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9
Apr 22 02:39:30 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:31 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 1073741824" returned: 0 in 0.518s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:31 devstack sudo[86856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52
Apr 22 02:39:31 devstack sudo[86856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Acquiring lock "cinder-2fd10142-3b52-410f-916e-c83131933ba7-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Lock "cinder-2fd10142-3b52-410f-916e-c83131933ba7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:31 devstack sudo[86861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:31 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Acquiring lock "cinder-quobyte-2fd10142-3b52-410f-916e-c83131933ba7" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Lock "cinder-quobyte-2fd10142-3b52-410f-916e-c83131933ba7" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f743f5-ec9d-4dfa-8de2-74b8c92ae0a9]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:31 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9" returned: 0 in 0.596s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:31 devstack sudo[86866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9
Apr 22 02:39:31 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:31 devstack sudo[86856]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52" returned: 0 in 0.593s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5001bd9e-4bfe-4d7b-bcaf-6833b5ec350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565a10b5-17f9-42be-9579-23189987a538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:31 devstack sudo[86864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7
Apr 22 02:39:31 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:31 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Volume volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 (d3551a81-6a0e-4c38-b89a-8dec5a587b52): created successfully
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565a10b5-17f9-42be-9579-23189987a538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Flow 'volume_create_manager' (7de3a734-c1f4-46a8-8413-1027283b66d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f57538e4-4d89-4e1f-b3a5-5b31ad20faaf tempest-GroupSnapshotsTest-92685635 None] Created volume successfully.
Apr 22 02:39:32 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.587s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:32 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7" returned: 0 in 0.649s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:32 devstack sudo[86898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7
Apr 22 02:39:32 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:32 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2.2f36164d-813d-4c7d-b3e2-99ea371669f9" returned: 0 in 0.651s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-2f36164d-813d-4c7d-b3e2-99ea371669f9" released by "_delete_snapshot" :: held 2.402s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-35016509-02e4-44e7-b4da-75adf3ef4bf2" released by "delete_snapshot" :: held 2.427s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Created reservations ['d9876d09-676e-4a50-bc1b-33a618bc96a3', '8ec8b263-9fa1-41ee-b9c3-38ce0f99d1b2', 'd36f3879-39d9-485e-adf8-627fe9ac0e8f', '8ee7e503-6170-4f8e-8354-10475dade0cd'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:32 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] GroupSnapshot b111b9f6-d16b-4d81-b5ef-e48e95a17ad3: creating.
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Group snapshot b111b9f6-d16b-4d81-b5ef-e48e95a17ad3: creating. {{(pid=82678) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Creating offline snapshot 189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 of volume d3551a81-6a0e-4c38-b89a-8dec5a587b52 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:39:32 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Delete snapshot completed successfully.
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb9ac9c-afb0-4df1-b802-1f67867ca1a7]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-2f36164d-813d-4c7d-b3e2-99ea371669f9-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Snapshots deleted, issuing volume delete {{(pid=82678) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-35016509-02e4-44e7-b4da-75adf3ef4bf2" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-35016509-02e4-44e7-b4da-75adf3ef4bf2" acquired by "delete_volume" :: waited 0.024s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e746d0c1-370a-4339-833a-3bc156cddd63]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:32 devstack sudo[86901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52
Apr 22 02:39:32 devstack sudo[86901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:32 devstack sudo[86903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2
Apr 22 02:39:32 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:32 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2fd10142-3b52-410f-916e-c83131933ba7" returned: 0 in 0.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Lock "cinder-quobyte-2fd10142-3b52-410f-916e-c83131933ba7" released by "delete_volume" :: held 1.209s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Created reservations ['17a38ab2-ce74-492b-98c1-7d97e033c99a', '35c906d4-fcc2-410b-91db-03ca24748921', 'ac1317d0-22df-458c-826d-5e005a249d8f', '2f0d23f9-482d-4a94-b6e2-10b28eb37dbc'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:32 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:32 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:32 devstack sudo[86901]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52" returned: 0 in 0.539s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:32 devstack sudo[86915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 1G
Apr 22 02:39:32 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:32 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2" returned: 0 in 0.529s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:32 devstack sudo[86917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2
Apr 22 02:39:32 devstack sudo[86917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:33 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.422s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:33 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Deleted volume successfully.
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ac37e9e-bc9e-41d9-9a76-731c012c0ccb tempest-VolumesTransfersV357Test-1599240676 None] Lock "cinder-2fd10142-3b52-410f-916e-c83131933ba7-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:33 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 1G" returned: 0 in 0.514s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:33 devstack sudo[86917]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-35016509-02e4-44e7-b4da-75adf3ef4bf2" returned: 0 in 0.466s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-35016509-02e4-44e7-b4da-75adf3ef4bf2" released by "delete_volume" :: held 1.037s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:33 devstack sudo[86924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3
Apr 22 02:39:33 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Created reservations ['5a9243a7-47f7-4f7e-8e5b-25f326497911', '199a1f05-cd89-4981-9936-b58ccf773a38', '64f1d85c-b69b-411e-9da0-268e5b5e36f7', '08421907-484d-4004-85f7-f10443d96177'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:33 devstack sudo[86927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:33 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:33 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3" returned: 0 in 0.528s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:33 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:39:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:33 devstack sudo[86943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3
Apr 22 02:39:33 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-6361e680-5b84-4ba6-8cd2-9381f93f8210-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:34 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.591s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-6361e680-5b84-4ba6-8cd2-9381f93f8210-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:34 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Deleted volume successfully.
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "cinder-quobyte-6361e680-5b84-4ba6-8cd2-9381f93f8210" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2d679aba-dbbf-4169-9125-d8a3ce549c6b tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-35016509-02e4-44e7-b4da-75adf3ef4bf2-delete_volume" released by "delete_volume" :: held 4.558s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-6361e680-5b84-4ba6-8cd2-9381f93f8210" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e15c2-6fdc-466d-95cb-cf6538fa81ec]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:34 devstack sudo[86953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210
Apr 22 02:39:34 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:34 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3" returned: 0 in 0.570s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:34 devstack sudo[86956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.info
Apr 22 02:39:34 devstack sudo[86956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:34 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210" returned: 0 in 0.526s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:34 devstack sudo[86961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210
Apr 22 02:39:34 devstack sudo[86961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:35 devstack sudo[86956]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.info" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:35 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:35 devstack sudo[86964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.info
Apr 22 02:39:35 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:35 devstack sudo[86961]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6361e680-5b84-4ba6-8cd2-9381f93f8210" returned: 0 in 0.494s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-quobyte-6361e680-5b84-4ba6-8cd2-9381f93f8210" released by "delete_volume" :: held 1.052s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Created reservations ['16c55508-fba9-4a77-9470-ca6ff2b96d3b', '9bbc97bc-462b-443c-a3c3-8218598489a5', 'f5b45321-d05c-4d06-af74-91052c1ca82b', 'a6ee8fa4-242f-494d-86b8-00e984d76135'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:35 devstack sudo[86967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:35 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:35 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.info" returned: 0 in 0.443s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.164s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-877b47be-2ce0-48bf-aa2a-a0abe52f4141 tempest-GroupSnapshotsTest-92685635 None] group_snapshot b111b9f6-d16b-4d81-b5ef-e48e95a17ad3: created successfully
Apr 22 02:39:35 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.521s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Deleted volume successfully.
Apr 22 02:39:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6eb8238f-5e3d-422d-b0cc-4b0e4472c0dd tempest-VolumesDeleteCascade-1649240436 None] Lock "cinder-6361e680-5b84-4ba6-8cd2-9381f93f8210-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:36 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] group_snapshot b111b9f6-d16b-4d81-b5ef-e48e95a17ad3: deleting
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] group_snapshot b111b9f6-d16b-4d81-b5ef-e48e95a17ad3: deleting {{(pid=82678) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-d3551a81-6a0e-4c38-b89a-8dec5a587b52" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-d3551a81-6a0e-4c38-b89a-8dec5a587b52" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Deleting offline snapshot 189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 of volume d3551a81-6a0e-4c38-b89a-8dec5a587b52 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] snapshot_file for this snap is: volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[309a9501-63d1-4eec-b164-6821b51b2930]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:36 devstack sudo[86972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3
Apr 22 02:39:36 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:37 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3" returned: 0 in 0.678s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdaf8f4-5841-4406-a9a8-3f57cbfc43de]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Flow 'volume_create_manager' (bacd058a-ea4c-41e7-9567-4394bd5cf9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5277938-f601-46e1-8fcf-dc060651edcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5277938-f601-46e1-8fcf-dc060651edcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-111684820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22d4414-eeaf-45c6-a525-238ac707d277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91070c2010304618add93463a58a0aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:37Z,use_quota=True,user_id='41b4dc4944b0483389f134ef698d400d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bfcb11-be63-4888-81f0-ac5385aa546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0bfcb11-be63-4888-81f0-ac5385aa546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bf6f27-668b-461d-90c3-11e2db3ff4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bf6f27-668b-461d-90c3-11e2db3ff4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22d4414-eeaf-45c6-a525-238ac707d277', 'volume_name': 'volume-b22d4414-eeaf-45c6-a525-238ac707d277', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4c75ea-cbec-48a8-aaa9-136a3460037d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4c75ea-cbec-48a8-aaa9-136a3460037d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:37 devstack sudo[86977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52
Apr 22 02:39:37 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cc5de1-14c9-4ff1-bb4b-bb5d429d14f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:37 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Volume b22d4414-eeaf-45c6-a525-238ac707d277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22d4414-eeaf-45c6-a525-238ac707d277', 'volume_size': 1}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-111684820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22d4414-eeaf-45c6-a525-238ac707d277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91070c2010304618add93463a58a0aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:37Z,use_quota=True,user_id='41b4dc4944b0483389f134ef698d400d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Creating volume b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:37 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:37 devstack sudo[86979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 1073741824
Apr 22 02:39:37 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:37 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52" returned: 0 in 0.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:37 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3
Apr 22 02:39:37 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:38 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 1073741824" returned: 0 in 0.542s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:38 devstack sudo[86993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277
Apr 22 02:39:38 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Flow 'volume_create_manager' (95d78fdf-ea20-49c5-b12a-706d5f0fe3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54692b5-6da2-4ed8-9a74-2a4978f2490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54692b5-6da2-4ed8-9a74-2a4978f2490f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1747038322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b3e7bb-8a38-4152-95e6-e82676942b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7effb323fe47b5b37b02de07971798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:39Z,use_quota=True,user_id='36616cca0b83423d8b06e108d5fef50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:38 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588ebacf-4134-4d48-bc1d-55af3b6fbbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588ebacf-4134-4d48-bc1d-55af3b6fbbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50fc04c-03e2-43e5-9289-c381476ab056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50fc04c-03e2-43e5-9289-c381476ab056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b3e7bb-8a38-4152-95e6-e82676942b63', 'volume_name': 'volume-a8b3e7bb-8a38-4152-95e6-e82676942b63', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fb0b65-2dcb-456d-8be7-79ca19fc76f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fb0b65-2dcb-456d-8be7-79ca19fc76f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9b6543-4e41-4131-af75-a5afdbd64be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:38 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Volume a8b3e7bb-8a38-4152-95e6-e82676942b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b3e7bb-8a38-4152-95e6-e82676942b63', 'volume_size': 1}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3" returned: 0 in 1.018s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:38 devstack sudo[87039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3
Apr 22 02:39:38 devstack sudo[87039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:39 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277" returned: 0 in 1.153s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1747038322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b3e7bb-8a38-4152-95e6-e82676942b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7effb323fe47b5b37b02de07971798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:39Z,use_quota=True,user_id='36616cca0b83423d8b06e108d5fef50b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Creating volume a8b3e7bb-8a38-4152-95e6-e82676942b63 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:39 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cc5de1-14c9-4ff1-bb4b-bb5d429d14f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22d4414-eeaf-45c6-a525-238ac707d277', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10a8a93-92bf-432d-b72f-88f377a03ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:39 devstack sudo[87044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63 1073741824
Apr 22 02:39:39 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:39 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Volume volume-b22d4414-eeaf-45c6-a525-238ac707d277 (b22d4414-eeaf-45c6-a525-238ac707d277): created successfully
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10a8a93-92bf-432d-b72f-88f377a03ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Flow 'volume_create_manager' (bacd058a-ea4c-41e7-9567-4394bd5cf9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:39 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e933d4c8-5337-4e80-a10f-968ac7f2ffb1 tempest-VolumesCloneTest-1802639824 None] Created volume successfully.
Apr 22 02:39:39 devstack sudo[87039]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52.189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3" returned: 0 in 0.598s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-189435a1-4c6e-4ea5-903a-b2e1dbcb3ca3" released by "_delete_snapshot" :: held 2.906s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-d3551a81-6a0e-4c38-b89a-8dec5a587b52" released by "delete_snapshot" :: held 2.917s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:39 devstack cinder-volume[82678]: WARNING cinder.quota [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-182608512 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-182608512, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:39:39 devstack cinder-volume[82678]: WARNING cinder.quota [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-182608512 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-182608512, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] Created reservations ['fc49bb2f-376c-455a-8c48-83e292773eec', 'cc9fd781-70d5-45e6-84e4-a3d86da64d72', '6aaf101b-fa2b-4b70-8c64-66347703c8ae', '9621d0c5-dac7-4bbe-bc2b-b355352577f1'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:39 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-14feb5d4-10c3-4aef-8fce-c12a48767faa tempest-GroupSnapshotsTest-92685635 None] group_snapshot b111b9f6-d16b-4d81-b5ef-e48e95a17ad3: deleted successfully
Apr 22 02:39:39 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63 1073741824" returned: 0 in 0.655s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Flow 'volume_create_manager' (bbbe7ca2-7ea9-42cf-a3ae-f540f90d9e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16aa539-2fbe-4887-be8a-2effd4adf258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16aa539-2fbe-4887-be8a-2effd4adf258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1253211993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467de2ec-6dd3-4c25-b506-7c9c19f00a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91070c2010304618add93463a58a0aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=b22d4414-eeaf-45c6-a525-238ac707d277,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:40Z,use_quota=True,user_id='41b4dc4944b0483389f134ef698d400d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9b8602-dbec-4b14-b9eb-aa6ec4ff14b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9b8602-dbec-4b14-b9eb-aa6ec4ff14b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e1aa03-0341-4b98-a856-fa242a227ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e1aa03-0341-4b98-a856-fa242a227ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '467de2ec-6dd3-4c25-b506-7c9c19f00a44', 'volume_name': 'volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44', 'volume_size': 2, 'source_volid': 'b22d4414-eeaf-45c6-a525-238ac707d277', 'source_volstatus': 'available'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c16d23-f8fa-430e-b7e8-b1f9dc460564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c16d23-f8fa-430e-b7e8-b1f9dc460564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b006c47a-5cfd-407e-b99b-88f35a1083e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:39 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Volume 467de2ec-6dd3-4c25-b506-7c9c19f00a44: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44', 'volume_size': 2, 'source_volid': 'b22d4414-eeaf-45c6-a525-238ac707d277', 'source_volstatus': 'available'}
Apr 22 02:39:39 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63
Apr 22 02:39:39 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "cinder-quobyte-d3551a81-6a0e-4c38-b89a-8dec5a587b52" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-d3551a81-6a0e-4c38-b89a-8dec5a587b52" acquired by "delete_volume" :: waited 0.025s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52c7b1a-a89e-40c7-be91-1d89514697b5]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:40 devstack sudo[87052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52
Apr 22 02:39:40 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:40 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63" returned: 0 in 0.655s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.607s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:40 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Cloning volume b22d4414-eeaf-45c6-a525-238ac707d277 to volume 467de2ec-6dd3-4c25-b506-7c9c19f00a44
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9b6543-4e41-4131-af75-a5afdbd64be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b3e7bb-8a38-4152-95e6-e82676942b63', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cb50f9-21c0-4ad8-b3e6-91d0054dcd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Creating offline snapshot 8b993475-138a-4ab4-a43e-f56b2051e967 of volume b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:39:40 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Volume volume-a8b3e7bb-8a38-4152-95e6-e82676942b63 (a8b3e7bb-8a38-4152-95e6-e82676942b63): created successfully
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cb50f9-21c0-4ad8-b3e6-91d0054dcd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Flow 'volume_create_manager' (95d78fdf-ea20-49c5-b12a-706d5f0fe3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44b7ac0-844f-4bf1-bfde-a9af013e82fa]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:40 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-cf05dc36-3066-4f28-84fe-c69387c8f164 tempest-VolumesMetadataTest-1458221107 None] Created volume successfully.
Apr 22 02:39:40 devstack sudo[87057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277
Apr 22 02:39:40 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:40 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52" returned: 0 in 0.747s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:40 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52
Apr 22 02:39:40 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:41 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277" returned: 0 in 0.596s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:41 devstack sudo[87067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 1G
Apr 22 02:39:41 devstack sudo[87067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Acquiring lock "cinder-a8b3e7bb-8a38-4152-95e6-e82676942b63-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Lock "cinder-a8b3e7bb-8a38-4152-95e6-e82676942b63-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:41 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d3551a81-6a0e-4c38-b89a-8dec5a587b52" returned: 0 in 0.546s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Lock "cinder-quobyte-d3551a81-6a0e-4c38-b89a-8dec5a587b52" released by "delete_volume" :: held 1.335s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Acquiring lock "cinder-quobyte-a8b3e7bb-8a38-4152-95e6-e82676942b63" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['9c4d9d4e-2239-4455-94bf-cadf89204497'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Lock "cinder-quobyte-a8b3e7bb-8a38-4152-95e6-e82676942b63" acquired by "delete_volume" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:41 devstack cinder-volume[82678]: WARNING cinder.quota [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-182608512 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-182608512, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Created reservations ['4277b428-ef08-4652-8b5e-d108dba02753', 'e29d6999-bb8a-47c9-aa94-cea5a393cd81', 'c51d2382-e50d-4cb6-a6c6-43cad574f58c', '1504c577-d9e1-4ebf-827d-6aad5eb028d4'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[90857c85-f42a-4ef3-9023-dc791db10690]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:41 devstack sudo[87071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63
Apr 22 02:39:41 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:41 devstack sudo[87073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:41 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:42 devstack sudo[87067]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 1G" returned: 0 in 0.741s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b22d4414-eeaf-45c6-a525-238ac707d277 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:42 devstack sudo[87078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b22d4414-eeaf-45c6-a525-238ac707d277 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967
Apr 22 02:39:42 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:42 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63" returned: 0 in 0.677s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:42 devstack sudo[87084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63
Apr 22 02:39:42 devstack sudo[87084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:42 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.555s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:42 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-cd83d7c6-2e8a-4b59-98f8-6d3f267ae453 tempest-GroupSnapshotsTest-92685635 None] Delete group completed successfully.
Apr 22 02:39:42 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b22d4414-eeaf-45c6-a525-238ac707d277 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967" returned: 0 in 0.548s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:42 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 is being set with open permissions: ugo+rw
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:42 devstack sudo[87089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967
Apr 22 02:39:42 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:42 devstack sudo[87084]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a8b3e7bb-8a38-4152-95e6-e82676942b63" returned: 0 in 0.417s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Lock "cinder-quobyte-a8b3e7bb-8a38-4152-95e6-e82676942b63" released by "delete_volume" :: held 1.156s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Created reservations ['381efb8d-c50f-4b41-a933-116d42576a5f', '7d661dfd-7c02-4f92-8d8f-c5a7ec6af115', 'c50593c6-4725-46dd-92aa-80796d554787', '9c490941-30bc-4b89-8674-85c7e07b8f2e'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:42 devstack sudo[87092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:42 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:43 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967" returned: 0 in 0.669s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:43 devstack sudo[87119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.info
Apr 22 02:39:43 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:43 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.587s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:43 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:43 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Deleted volume successfully.
Apr 22 02:39:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50ea249a-45b5-4080-9e4a-70f93b449c3e tempest-VolumesMetadataTest-1458221107 None] Lock "cinder-a8b3e7bb-8a38-4152-95e6-e82676942b63-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:43 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.info" returned: 0 in 0.594s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:43 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.info is being set with open permissions: ugo+rw
Apr 22 02:39:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:43 devstack sudo[87139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.info
Apr 22 02:39:43 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:44 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.info" returned: 0 in 0.656s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "cinder-quobyte-467de2ec-6dd3-4c25-b506-7c9c19f00a44" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Lock "cinder-quobyte-467de2ec-6dd3-4c25-b506-7c9c19f00a44" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] snapshot: 8b993475-138a-4ab4-a43e-f56b2051e967, volume: 467de2ec-6dd3-4c25-b506-7c9c19f00a44,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0d42f-8e8a-4d23-9f69-dd9e0d8f2296]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:44 devstack sudo[87149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967
Apr 22 02:39:44 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:45 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967" returned: 0 in 0.639s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b22d4414-eeaf-45c6-a525-238ac707d277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c92201-f9b9-42f1-9db1-f6757b44ccb7]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:45 devstack sudo[87155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277
Apr 22 02:39:45 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:45 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277" returned: 0 in 0.582s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44 not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:39:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:45 devstack sudo[87161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44
Apr 22 02:39:45 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:49 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44" returned: 0 in 3.187s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[316d9ef7-7938-42c6-b852-cdfde3d4decc]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:49 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277
Apr 22 02:39:49 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Flow 'volume_create_manager' (1797d4b2-b6f4-4c2e-b1fe-995507c902a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a032a1a-bde9-47c7-85c2-5629bc286e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a032a1a-bde9-47c7-85c2-5629bc286e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-36311267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569730e9-756e-4304-8f3c-c9bcc4e5222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db914e766d3249beb6feae38af244a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:50Z,use_quota=True,user_id='42385a2a7132440bbf82b57e93273b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ca4dc7-6ddb-465b-99c4-5374433eb93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ca4dc7-6ddb-465b-99c4-5374433eb93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393c868e-7581-41ff-b1e9-8c610d0459f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393c868e-7581-41ff-b1e9-8c610d0459f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569730e9-756e-4304-8f3c-c9bcc4e5222c', 'volume_name': 'volume-569730e9-756e-4304-8f3c-c9bcc4e5222c', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fb881c-bfbf-42aa-9b60-c751e03b8c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fb881c-bfbf-42aa-9b60-c751e03b8c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fc40da-2b19-42de-b706-3f25d4f35494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:49 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Volume 569730e9-756e-4304-8f3c-c9bcc4e5222c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569730e9-756e-4304-8f3c-c9bcc4e5222c', 'volume_size': 1}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:49 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277" returned: 0 in 0.738s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277, size 1024.00 MB, duration 3.19 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:39:49 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Converted 1024.00 MB image at 321.17 MB/s
Apr 22 02:39:49 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44 is being set with open permissions: ugo+rw
Apr 22 02:39:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:49 devstack sudo[87208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44
Apr 22 02:39:49 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:50 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44" returned: 0 in 0.408s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Lock "cinder-quobyte-467de2ec-6dd3-4c25-b506-7c9c19f00a44" released by "_copy_volume_from_snapshot" :: held 5.639s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "cinder-quobyte-8b993475-138a-4ab4-a43e-f56b2051e967" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Lock "cinder-quobyte-8b993475-138a-4ab4-a43e-f56b2051e967" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Deleting offline snapshot 8b993475-138a-4ab4-a43e-f56b2051e967 of volume b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] snapshot_file for this snap is: volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d05976-e5b0-40a2-a10b-0a0c8f1e73f1]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:50 devstack sudo[87212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967
Apr 22 02:39:50 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:50 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-aa6a34f8-b050-4e5a-bdf7-eb9510be4c29 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Terminate volume connection completed successfully.
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-aa6a34f8-b050-4e5a-bdf7-eb9510be4c29 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Deleting attachment d6db1584-bcf6-4fe0-992e-40cc041db7da. {{(pid=82678) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 22 02:39:50 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967" returned: 0 in 0.539s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b22d4414-eeaf-45c6-a525-238ac707d277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d84584a-de8c-42c2-87d1-377ad210ee85]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:50 devstack sudo[87217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277
Apr 22 02:39:50 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "cinder-4d32fa5b-c6d3-4823-a910-128f7a404581-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "cinder-4d32fa5b-c6d3-4823-a910-128f7a404581-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "cinder-quobyte-4d32fa5b-c6d3-4823-a910-128f7a404581" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "cinder-quobyte-4d32fa5b-c6d3-4823-a910-128f7a404581" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[966f9da7-930c-4d76-8415-54d9116b7814]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:51 devstack sudo[87219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:51 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:51 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277" returned: 0 in 0.593s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:51 devstack sudo[87224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967
Apr 22 02:39:51 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:51 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 0 in 0.584s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:51 devstack sudo[87229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:51 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:51 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967" returned: 0 in 0.562s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:51 devstack sudo[87234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967
Apr 22 02:39:51 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:52 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 1 in 0.539s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:52 devstack sudo[87239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581
Apr 22 02:39:52 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:52 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277.8b993475-138a-4ab4-a43e-f56b2051e967" returned: 0 in 0.508s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Lock "cinder-quobyte-8b993475-138a-4ab4-a43e-f56b2051e967" released by "_delete_snapshot" :: held 2.265s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.894s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.839s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-36311267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569730e9-756e-4304-8f3c-c9bcc4e5222c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db914e766d3249beb6feae38af244a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:50Z,use_quota=True,user_id='42385a2a7132440bbf82b57e93273b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Creating volume 569730e9-756e-4304-8f3c-c9bcc4e5222c {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:52 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b006c47a-5cfd-407e-b99b-88f35a1083e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44', 'volume_size': 2, 'source_volid': 'b22d4414-eeaf-45c6-a525-238ac707d277', 'source_volstatus': 'available'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fd01de-9bc0-4723-b425-edb29c158772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:52 devstack sudo[87243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c 1073741824
Apr 22 02:39:52 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Volume volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44 (467de2ec-6dd3-4c25-b506-7c9c19f00a44): created successfully
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fd01de-9bc0-4723-b425-edb29c158772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Flow 'volume_create_manager' (bbbe7ca2-7ea9-42cf-a3ae-f540f90d9e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5e466f8c-cb1b-4d9a-9fa6-e933b0423856 tempest-VolumesCloneTest-1802639824 None] Created volume successfully.
Apr 22 02:39:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-12dc1251-cbc1-4758-9151-c7864a27fea3 tempest-GroupsV314Test-760255596 None] Group tempest-GroupsV314Test-Group-714928795: creating
Apr 22 02:39:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-12dc1251-cbc1-4758-9151-c7864a27fea3 tempest-GroupsV314Test-760255596 None] Group tempest-GroupsV314Test-Group-714928795: created successfully
Apr 22 02:39:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-12dc1251-cbc1-4758-9151-c7864a27fea3 tempest-GroupsV314Test-760255596 None] Create group completed successfully.
Apr 22 02:39:52 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d32fa5b-c6d3-4823-a910-128f7a404581" returned: 0 in 0.490s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "cinder-quobyte-4d32fa5b-c6d3-4823-a910-128f7a404581" released by "delete_volume" :: held 1.673s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.quota [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Created reservations ['8ae20217-0c10-4430-8f2d-fbe6071211f3', '30660043-423a-4b49-99cb-a6ac02ba5038', '4707bb74-da74-4f70-996e-12a529ba2407', 'e9d316fd-a7a2-4320-864b-f3481e45431c'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:52 devstack sudo[87246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:52 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "cinder-467de2ec-6dd3-4c25-b506-7c9c19f00a44-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Lock "cinder-467de2ec-6dd3-4c25-b506-7c9c19f00a44-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "cinder-quobyte-467de2ec-6dd3-4c25-b506-7c9c19f00a44" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Lock "cinder-quobyte-467de2ec-6dd3-4c25-b506-7c9c19f00a44" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[82309ff3-5a59-4e67-b255-49e401f35683]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:53 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c 1073741824" returned: 0 in 0.576s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:53 devstack sudo[87251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44
Apr 22 02:39:53 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:53 devstack sudo[87253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c
Apr 22 02:39:53 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:53 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.470s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.manager [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:53 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Deleted volume successfully.
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-379de426-f8f7-40f9-a201-1feb52e63ed5 req-f3d9e9ba-43dc-48ca-8f07-602ebee5f2a3 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "cinder-4d32fa5b-c6d3-4823-a910-128f7a404581-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:53 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44" returned: 0 in 0.537s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:53 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c" returned: 0 in 0.468s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:53 devstack sudo[87260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44
Apr 22 02:39:53 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fc40da-2b19-42de-b706-3f25d4f35494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569730e9-756e-4304-8f3c-c9bcc4e5222c', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a00abb-0536-4a35-aee0-63f94128f054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:53 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Volume volume-569730e9-756e-4304-8f3c-c9bcc4e5222c (569730e9-756e-4304-8f3c-c9bcc4e5222c): created successfully
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a00abb-0536-4a35-aee0-63f94128f054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Flow 'volume_create_manager' (1797d4b2-b6f4-4c2e-b1fe-995507c902a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:53 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-90e34621-c5b3-4635-bc05-823d5fb962e2 tempest-VolumesTransfersTest-228091865 None] Created volume successfully.
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Flow 'volume_create_manager' (41052429-9b73-49d5-9969-0446f473e595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f2f93d-69f6-424f-b902-cc05cea49dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f2f93d-69f6-424f-b902-cc05cea49dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-552764101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebf904a7-1d63-4580-b67d-4977e7320f21,host='devstack@QuobyteHD#QuobyteHD',id=da284291-7234-43a9-bbf5-27d7bdfcfe15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13133eb59dda42ed9dc7d48316d39377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:54Z,use_quota=True,user_id='bb7a2108291a4849a3dc067f32f767ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48b1a93f-03b3-4d45-95ac-ad7fa380286b),volume_type_id=48b1a93f-03b3-4d45-95ac-ad7fa380286b)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2decf7-147d-4cf0-8f99-7173d7b45b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2decf7-147d-4cf0-8f99-7173d7b45b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd695dfd-b840-4f7f-a0e1-d113da922b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd695dfd-b840-4f7f-a0e1-d113da922b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da284291-7234-43a9-bbf5-27d7bdfcfe15', 'volume_name': 'volume-da284291-7234-43a9-bbf5-27d7bdfcfe15', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70072225-65e6-427b-95af-75f93a4a9f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70072225-65e6-427b-95af-75f93a4a9f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357ddae8-2594-43f4-b416-813655beaefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:54 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Volume da284291-7234-43a9-bbf5-27d7bdfcfe15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da284291-7234-43a9-bbf5-27d7bdfcfe15', 'volume_size': 1}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ebf904a7-1d63-4580-b67d-4977e7320f21,created_at=2026-04-22T00:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-552764101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ebf904a7-1d63-4580-b67d-4977e7320f21,host='devstack@QuobyteHD#QuobyteHD',id=da284291-7234-43a9-bbf5-27d7bdfcfe15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13133eb59dda42ed9dc7d48316d39377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:54Z,use_quota=True,user_id='bb7a2108291a4849a3dc067f32f767ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48b1a93f-03b3-4d45-95ac-ad7fa380286b),volume_type_id=48b1a93f-03b3-4d45-95ac-ad7fa380286b)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Creating volume da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:39:54 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:54 devstack sudo[87264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 1073741824
Apr 22 02:39:54 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:54 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-467de2ec-6dd3-4c25-b506-7c9c19f00a44" returned: 0 in 0.590s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Lock "cinder-quobyte-467de2ec-6dd3-4c25-b506-7c9c19f00a44" released by "delete_volume" :: held 1.162s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Created reservations ['42a149b1-833a-443f-9402-481c5b65399d', '1e5bd669-7b80-4ec2-ba77-196bc87e763e', 'a2f28f8a-021a-4a4f-8a76-4e5c419ce2e7', '0976494f-9d8f-45d4-b979-6c2eaba290bd'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:54 devstack sudo[87266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:54 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-55f818bd-61de-4c77-a872-527544468b8f tempest-VolumesTransfersTest-926306602 None] Transfer volume completed successfully.
Apr 22 02:39:54 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 1073741824" returned: 0 in 0.538s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:54 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.427s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Deleted volume successfully.
Apr 22 02:39:54 devstack sudo[87272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15
Apr 22 02:39:54 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-857acd5d-8260-4ef1-a971-8038b3bdcd84 tempest-VolumesCloneTest-1802639824 None] Lock "cinder-467de2ec-6dd3-4c25-b506-7c9c19f00a44-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Acquiring lock "cinder-569730e9-756e-4304-8f3c-c9bcc4e5222c-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Lock "cinder-569730e9-756e-4304-8f3c-c9bcc4e5222c-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:55 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15" returned: 0 in 0.565s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357ddae8-2594-43f4-b416-813655beaefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da284291-7234-43a9-bbf5-27d7bdfcfe15', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6830eb-9c0a-4200-9575-643877d7f0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Acquiring lock "cinder-quobyte-569730e9-756e-4304-8f3c-c9bcc4e5222c" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:55 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Volume volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 (da284291-7234-43a9-bbf5-27d7bdfcfe15): created successfully
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6830eb-9c0a-4200-9575-643877d7f0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Flow 'volume_create_manager' (41052429-9b73-49d5-9969-0446f473e595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Lock "cinder-quobyte-569730e9-756e-4304-8f3c-c9bcc4e5222c" acquired by "delete_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:55 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6eef6cce-65b7-43fa-ae35-f3dd02140ff9 tempest-GroupsV314Test-760255596 None] Created volume successfully.
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[465cb618-fc02-4f7f-93df-0d256cbcbb92]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Acquiring lock "cinder-b22d4414-eeaf-45c6-a525-238ac707d277-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Lock "cinder-b22d4414-eeaf-45c6-a525-238ac707d277-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Acquiring lock "cinder-quobyte-b22d4414-eeaf-45c6-a525-238ac707d277" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Lock "cinder-quobyte-b22d4414-eeaf-45c6-a525-238ac707d277" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaaca15-bb95-4bbf-96f3-3adba86f6ed8]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:55 devstack sudo[87299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c
Apr 22 02:39:55 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:55 devstack sudo[87302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277
Apr 22 02:39:55 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:55 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:55 devstack sudo[87309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c
Apr 22 02:39:55 devstack sudo[87309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:55 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:55 devstack sudo[87312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277
Apr 22 02:39:55 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:56 devstack sudo[87309]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-569730e9-756e-4304-8f3c-c9bcc4e5222c" returned: 0 in 0.503s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Lock "cinder-quobyte-569730e9-756e-4304-8f3c-c9bcc4e5222c" released by "delete_volume" :: held 1.036s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:56 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=194,cinder:DELETE=16,cinder:UPDATE=215,cinder:INSERT=58 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b22d4414-eeaf-45c6-a525-238ac707d277" returned: 0 in 0.443s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Created reservations ['8702551d-406e-4ad9-bd39-3e961e8919fa', '0b6c5ab8-f1ed-4cf5-961e-ed5061bab37b', '671396e1-fd39-4795-b259-4867f878b788', '7e0c75fc-18d6-4390-b74e-e13df4152242'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Lock "cinder-quobyte-b22d4414-eeaf-45c6-a525-238ac707d277" released by "delete_volume" :: held 0.999s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Created reservations ['b4aee554-3eda-4dfe-848a-9661b424374b', 'f2a1d22c-cb4a-4772-9da7-03e7b4463b94', 'c1b90c91-eab7-468d-8d26-55be2db11feb', 'e896078e-f60f-4ada-8402-fc405b315f07'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:39:56 devstack sudo[87317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:56 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:56 devstack sudo[87320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:39:56 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:56 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:56 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Deleted volume successfully.
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5148e574-bafd-4e80-ab3e-e922084063ea tempest-VolumesTransfersTest-436344136 None] Lock "cinder-569730e9-756e-4304-8f3c-c9bcc4e5222c-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:56 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.412s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:39:56 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Deleted volume successfully.
Apr 22 02:39:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b1baec56-6f26-4260-9eed-1ed12e4d29ef tempest-VolumesCloneTest-1802639824 None] Lock "cinder-b22d4414-eeaf-45c6-a525-238ac707d277-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:39:57 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Cloning volume da284291-7234-43a9-bbf5-27d7bdfcfe15 to volume 17812d01-8ca8-47a3-8980-4676aedfa96d
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Creating offline snapshot 38496879-eb15-49aa-a899-79d3977d4822 of volume da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c4bfad-4bee-48e9-9f16-557d0e9795d1]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:57 devstack sudo[87324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15
Apr 22 02:39:57 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:57 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15" returned: 0 in 0.607s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:57 devstack sudo[87329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 1G
Apr 22 02:39:57 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Flow 'volume_create_manager' (6e66bfb7-f27f-48a8-877a-7076f9e9325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bb86df-881b-4242-957a-e221c2620db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bb86df-881b-4242-957a-e221c2620db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1911262529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db914e766d3249beb6feae38af244a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:58Z,use_quota=True,user_id='42385a2a7132440bbf82b57e93273b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688fcc6f-0f42-4d75-99a4-fdfffd279a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (688fcc6f-0f42-4d75-99a4-fdfffd279a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55895964-398f-445c-a54e-2c194a23854b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55895964-398f-445c-a54e-2c194a23854b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec', 'volume_name': 'volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e59e18-e5ae-48b0-93f6-b7d9da188737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e59e18-e5ae-48b0-93f6-b7d9da188737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81687b00-9f36-4d28-92b3-b806dff557bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:57 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Volume 7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec', 'volume_size': 1}
Apr 22 02:39:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:58 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 1G" returned: 0 in 0.571s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:58 devstack sudo[87334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822
Apr 22 02:39:58 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:58 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822" returned: 0 in 0.493s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:58 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:39:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:58 devstack sudo[87339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822
Apr 22 02:39:58 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:59 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822" returned: 0 in 0.483s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (f4fc735b-eb36-4405-8c4d-74206e0228dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:39:59 devstack sudo[87342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.info
Apr 22 02:39:59 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baff4963-b363-4612-b536-e1aa416becdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baff4963-b363-4612-b536-e1aa416becdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-383878849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:59Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b039f11-be62-4394-b055-10576dbca386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b039f11-be62-4394-b055-10576dbca386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e72aa1-3426-4412-8f72-945aee5d563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e72aa1-3426-4412-8f72-945aee5d563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13', 'volume_name': 'volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09bcadd-7e7c-4677-ae60-49fbb218c6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09bcadd-7e7c-4677-ae60-49fbb218c6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e3ea65-186a-41c9-afee-8db21f6a4689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:39:59 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Volume 00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13', 'volume_size': 1}
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:39:59 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.info" returned: 0 in 0.408s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:39:59 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:39:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:39:59 devstack sudo[87345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.info
Apr 22 02:39:59 devstack sudo[87345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:00 devstack sudo[87345]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.info" returned: 0 in 0.458s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Acquiring lock "cinder-quobyte-17812d01-8ca8-47a3-8980-4676aedfa96d" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Lock "cinder-quobyte-17812d01-8ca8-47a3-8980-4676aedfa96d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] snapshot: 38496879-eb15-49aa-a899-79d3977d4822, volume: 17812d01-8ca8-47a3-8980-4676aedfa96d,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d295f-ae58-4ce7-b778-549a03467101]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:00 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822
Apr 22 02:40:00 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:00 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da284291-7234-43a9-bbf5-27d7bdfcfe15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[78acd8ae-c245-4305-919e-952e33f751e3]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:00 devstack sudo[87354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15
Apr 22 02:40:00 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:01 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15" returned: 0 in 0.534s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:01 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:40:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:01 devstack sudo[87370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d
Apr 22 02:40:01 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:03 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d" returned: 0 in 2.336s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[103dd78c-5667-4fd3-b6e4-5b44a20fcbaf]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:03 devstack sudo[87398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15
Apr 22 02:40:03 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:04 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15" returned: 0 in 0.595s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15, size 1024.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:40:04 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Converted 1024.00 MB image at 438.14 MB/s
Apr 22 02:40:04 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d is being set with open permissions: ugo+rw: NotImplementedError
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:04 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d
Apr 22 02:40:04 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:04 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-adda565b-f907-455f-ba8d-7125d64e8c6e tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Terminate volume connection completed successfully.
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-adda565b-f907-455f-ba8d-7125d64e8c6e tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Deleting attachment 2b9ef057-e592-4368-b476-a7b9e50c9ed3. {{(pid=82678) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 22 02:40:04 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d" returned: 0 in 0.432s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Lock "cinder-quobyte-17812d01-8ca8-47a3-8980-4676aedfa96d" released by "_copy_volume_from_snapshot" :: held 4.449s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Acquiring lock "cinder-quobyte-38496879-eb15-49aa-a899-79d3977d4822" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Lock "cinder-quobyte-38496879-eb15-49aa-a899-79d3977d4822" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Deleting offline snapshot 38496879-eb15-49aa-a899-79d3977d4822 of volume da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] snapshot_file for this snap is: volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebbdc76-939b-44a7-b036-d6cccff90c20]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:04 devstack sudo[87406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822
Apr 22 02:40:04 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "cinder-90b0e9a0-de9d-499f-b554-70e547fd2560-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "cinder-90b0e9a0-de9d-499f-b554-70e547fd2560-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "cinder-quobyte-90b0e9a0-de9d-499f-b554-70e547fd2560" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "cinder-quobyte-90b0e9a0-de9d-499f-b554-70e547fd2560" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[8437c70a-c851-4846-968c-0b4e4d202d99]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:05 devstack sudo[87411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560
Apr 22 02:40:05 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:05 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da284291-7234-43a9-bbf5-27d7bdfcfe15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[de73c007-846c-4a54-a8a7-c15cb693c46c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:05 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15
Apr 22 02:40:05 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:05 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560" returned: 0 in 0.525s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:05 devstack sudo[87418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560
Apr 22 02:40:05 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:05 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15" returned: 0 in 0.495s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:05 devstack sudo[87423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822
Apr 22 02:40:05 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:05 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90b0e9a0-de9d-499f-b554-70e547fd2560" returned: 0 in 0.410s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "cinder-quobyte-90b0e9a0-de9d-499f-b554-70e547fd2560" released by "delete_volume" :: held 0.960s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.quota [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Created reservations ['089ccfab-3068-43e2-af96-dc35be0e77fc', '6d345c78-dcab-472c-8cbd-542574ff2487', '0d401dec-6f89-43d5-9997-ba550beb1c5f', '9aad9a2c-cec4-484c-915c-39449156e79e'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:06 devstack sudo[87429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:06 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:06 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822" returned: 0 in 0.473s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:06 devstack sudo[87431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822
Apr 22 02:40:06 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:06 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.441s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.manager [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:06 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Deleted volume successfully.
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-40d15d22-1ecb-4770-92a7-8e7501aa10df req-bda28292-4b5c-48ef-9ab2-2d61b325f240 tempest-ServerBootFromVolumeStableRescueTest-1854942287 None] Lock "cinder-90b0e9a0-de9d-499f-b554-70e547fd2560-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:06 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15.38496879-eb15-49aa-a899-79d3977d4822" returned: 0 in 0.431s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Lock "cinder-quobyte-38496879-eb15-49aa-a899-79d3977d4822" released by "_delete_snapshot" :: held 2.018s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.614s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.851s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1911262529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db914e766d3249beb6feae38af244a13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:58Z,use_quota=True,user_id='42385a2a7132440bbf82b57e93273b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Creating volume 7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:06 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:06 devstack sudo[87435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec 1073741824
Apr 22 02:40:06 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:06 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-730d3e1d-13fe-44e2-9334-e10a96f8323f tempest-GroupsV314Test-760255596 None] Create group from source-group-ebf904a7-1d63-4580-b67d-4977e7320f21 completed successfully.
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Acquiring lock "cinder-quobyte-17812d01-8ca8-47a3-8980-4676aedfa96d" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Lock "cinder-quobyte-17812d01-8ca8-47a3-8980-4676aedfa96d" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4197c9-bdc6-43d0-9a6b-b429a72a2bcf]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:07 devstack sudo[87440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d
Apr 22 02:40:07 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:07 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec 1073741824" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:07 devstack sudo[87442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec
Apr 22 02:40:07 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:07 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d" returned: 0 in 0.515s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:07 devstack sudo[87448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d
Apr 22 02:40:07 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:07 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec" returned: 0 in 0.458s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.325s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-383878849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:39:59Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Creating volume 00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:07 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81687b00-9f36-4d28-92b3-b806dff557bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ea95e5-92a2-4eab-b154-5c8d08a90593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:07 devstack sudo[87450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13 1073741824
Apr 22 02:40:07 devstack sudo[87450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:07 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Volume volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec (7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec): created successfully
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ea95e5-92a2-4eab-b154-5c8d08a90593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Flow 'volume_create_manager' (6e66bfb7-f27f-48a8-877a-7076f9e9325c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-fdbd9836-ccc1-42b4-9c13-071856fb571d tempest-VolumesTransfersTest-228091865 None] Created volume successfully.
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-17812d01-8ca8-47a3-8980-4676aedfa96d" returned: 0 in 0.458s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:08 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Lock "cinder-quobyte-17812d01-8ca8-47a3-8980-4676aedfa96d" released by "delete_volume" :: held 1.007s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Created reservations ['e19aa2f8-cf37-4b8d-9f82-0e2347acafae'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:08 devstack cinder-volume[82678]: WARNING cinder.quota [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1292170465 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1292170465, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:40:08 devstack cinder-volume[82678]: WARNING cinder.quota [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1292170465 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1292170465, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Created reservations ['98593df8-9af6-4ea7-9fa1-bae85cb452df', '4822d069-8018-4a19-85aa-e2a94598419d', 'c0cce9a2-6aba-4ae0-aa49-bb59e109cc38', '7cbfeb15-2397-48eb-b3e7-0e63ab8d0e46'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:08 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:08 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:08 devstack sudo[87450]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13 1073741824" returned: 0 in 0.619s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:08 devstack sudo[87459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13
Apr 22 02:40:08 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Acquiring lock "cinder-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Lock "cinder-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Acquiring lock "cinder-quobyte-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Lock "cinder-quobyte-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b215a-9525-4533-96e8-009fa633c306]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:08 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.469s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:08 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2f1ae704-e3ee-4914-98a6-eeebd130f232 tempest-GroupsV314Test-760255596 None] Delete group completed successfully.
Apr 22 02:40:08 devstack sudo[87462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec
Apr 22 02:40:08 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:08 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e3ea65-186a-41c9-afee-8db21f6a4689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fee0c88-ae6c-4179-ba56-987800f1c72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:08 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Volume volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13 (00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13): created successfully
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fee0c88-ae6c-4179-ba56-987800f1c72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (f4fc735b-eb36-4405-8c4d-74206e0228dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:08 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-fde4133e-bbbf-43b0-a861-b3771d2b37a1 tempest-VolumesGetTest-1780801094 None] Created volume successfully.
Apr 22 02:40:09 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec" returned: 0 in 0.550s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:09 devstack sudo[87493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec
Apr 22 02:40:09 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Acquiring lock "cinder-quobyte-da284291-7234-43a9-bbf5-27d7bdfcfe15" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Lock "cinder-quobyte-da284291-7234-43a9-bbf5-27d7bdfcfe15" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66aea88-0333-45a6-b761-f06c935598ce]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:09 devstack sudo[87496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15
Apr 22 02:40:09 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:09 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec" returned: 0 in 0.478s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Lock "cinder-quobyte-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec" released by "delete_volume" :: held 1.049s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Created reservations ['b032ee7e-2c39-4a3f-87d4-fb2d63149e2b', '377aed0d-d4df-4f7e-94f6-319f1fb63004', 'f37a7d4f-05b0-48b7-9e0d-0269b9d1c119', 'e420f73a-531c-4cd1-8f3e-977f19f3bb2b'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:09 devstack sudo[87499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:09 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:09 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15" returned: 0 in 0.529s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:09 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15
Apr 22 02:40:09 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (8a81cb68-6016-42e2-b211-6ba51659e385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71060435-53ac-4594-b646-44fbe168d9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71060435-53ac-4594-b646-44fbe168d9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-245034070',display_name='tempest-VolumesGetTest-Volume-62274862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c148913-58f7-4117-a732-ff4231aae786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:10Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c346eb99-fab0-433e-b639-ed93a4229492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c346eb99-fab0-433e-b639-ed93a4229492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85ea63e-0b7e-402f-a708-f7b3b781ecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85ea63e-0b7e-402f-a708-f7b3b781ecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c148913-58f7-4117-a732-ff4231aae786', 'volume_name': 'volume-0c148913-58f7-4117-a732-ff4231aae786', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:10 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5327df64-9ed1-480e-8ae3-db8a45758eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5327df64-9ed1-480e-8ae3-db8a45758eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bcb7ae-844d-4728-8654-0602c032505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:10 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Volume 0c148913-58f7-4117-a732-ff4231aae786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c148913-58f7-4117-a732-ff4231aae786', 'volume_size': 1}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-245034070',display_name='tempest-VolumesGetTest-Volume-62274862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c148913-58f7-4117-a732-ff4231aae786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:10Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Creating volume 0c148913-58f7-4117-a732-ff4231aae786 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:10 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.587s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:10 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Deleted volume successfully.
Apr 22 02:40:10 devstack sudo[87509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786 1073741824
Apr 22 02:40:10 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bcdc9caf-f8e0-4f07-9b7f-daa9fc8cc152 tempest-VolumesTransfersTest-436344136 None] Lock "cinder-7ea67e3f-fe2f-42ec-bc7a-0bab53bd22ec-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:10 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-da284291-7234-43a9-bbf5-27d7bdfcfe15" returned: 0 in 0.489s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Lock "cinder-quobyte-da284291-7234-43a9-bbf5-27d7bdfcfe15" released by "delete_volume" :: held 1.072s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Created reservations ['d3c3569e-83d4-4c32-a541-66142c768a61'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Created reservations ['abf7dafd-7d6f-4e79-ae60-f5e95ca4ea16', '1b5ade7e-2e5b-4d63-8c2b-994ef5f6ac2c', 'e119d30e-c357-4691-8c14-468473a7e8bd', '6fadbebb-a3ec-47aa-a217-c0abf8b192ca'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:10 devstack sudo[87512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:10 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:10 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786 1073741824" returned: 0 in 0.614s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:10 devstack sudo[87517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786
Apr 22 02:40:10 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:11 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.488s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:11 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e28ae762-88fe-41fc-b3c2-8ae9a7e4ceb1 tempest-GroupsV314Test-760255596 None] Delete group completed successfully.
Apr 22 02:40:11 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786" returned: 0 in 0.476s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bcb7ae-844d-4728-8654-0602c032505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c148913-58f7-4117-a732-ff4231aae786', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22970560-a888-4443-b851-6096bcb777e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:11 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Volume volume-0c148913-58f7-4117-a732-ff4231aae786 (0c148913-58f7-4117-a732-ff4231aae786): created successfully
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22970560-a888-4443-b851-6096bcb777e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (8a81cb68-6016-42e2-b211-6ba51659e385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:11 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ca6c9953-dda6-47e7-adad-dc3b4713ac0a tempest-VolumesGetTest-1780801094 None] Created volume successfully.
Apr 22 02:40:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-0c148913-58f7-4117-a732-ff4231aae786-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Lock "cinder-0c148913-58f7-4117-a732-ff4231aae786-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-0c148913-58f7-4117-a732-ff4231aae786" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-0c148913-58f7-4117-a732-ff4231aae786" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:12 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[42442182-6ecf-4db3-94b1-94120e78ee03]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:13 devstack sudo[87528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786
Apr 22 02:40:13 devstack sudo[87528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:13 devstack sudo[87528]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786" returned: 0 in 0.562s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:13 devstack sudo[87535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786
Apr 22 02:40:13 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:14 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0c148913-58f7-4117-a732-ff4231aae786" returned: 0 in 0.529s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-0c148913-58f7-4117-a732-ff4231aae786" released by "delete_volume" :: held 1.121s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Created reservations ['7f20d76e-bba0-42dd-ae91-e5a1e7f5c965', 'ad8843b3-5349-44df-90a1-d13aa7a1d20f', 'b5ca25fa-decc-4a9e-9865-d23e58ec1c56', '792da081-bee3-457f-965b-c7cb3576c895'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:14 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:14 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:14 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.503s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:14 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Deleted volume successfully.
Apr 22 02:40:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-4864b930-98d9-47fd-bf6d-b043ba17ccc6 tempest-VolumesGetTest-1780801094 None] Lock "cinder-0c148913-58f7-4117-a732-ff4231aae786-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Lock "cinder-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:15 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:15 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[180bfec9-57ed-4ad9-bf9a-817b0be693de]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:15 devstack sudo[87541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13
Apr 22 02:40:15 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:15 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13" returned: 0 in 0.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:15 devstack sudo[87547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13
Apr 22 02:40:15 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:16 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13" returned: 0 in 0.447s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13" released by "delete_volume" :: held 1.008s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Created reservations ['a5f23cc1-b176-47e9-ab1c-20f97e0f2635', 'c9d4aacb-ff5c-477e-89d5-961ee7664c7a', '8cc866ac-2887-471d-aff3-c4426583044f', 'cda66083-2b67-4416-917e-56eaebffff31'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:16 devstack sudo[87550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:16 devstack sudo[87550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:16 devstack sudo[87550]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.525s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:16 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Deleted volume successfully.
Apr 22 02:40:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9d6e9cd4-a519-4612-9e60-e1a3fa5d8b5d tempest-VolumesGetTest-1780801094 None] Lock "cinder-00cc89b8-cdf7-4ea0-bd5d-a5b7069c0f13-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (cb9c8619-da24-46b4-8e48-2ffad431fb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27217d68-34d6-47b5-9e44-1d8c52278c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27217d68-34d6-47b5-9e44-1d8c52278c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1032736300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cef12a9-6b04-4229-9cbd-c6b6b9196499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:17Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c510f0-2559-4202-90b2-43e473fcd8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c510f0-2559-4202-90b2-43e473fcd8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3415a33e-2772-425b-bd33-b1924ec10b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3415a33e-2772-425b-bd33-b1924ec10b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cef12a9-6b04-4229-9cbd-c6b6b9196499', 'volume_name': 'volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4da083-7c22-4e1f-ae79-1486b200eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a4da083-7c22-4e1f-ae79-1486b200eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a0013c-d8d8-42d1-922d-bef846d3b3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:17 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Volume 9cef12a9-6b04-4229-9cbd-c6b6b9196499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499', 'volume_size': 1}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1032736300',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cef12a9-6b04-4229-9cbd-c6b6b9196499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:17Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Creating volume 9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:17 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:17 devstack sudo[87553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 1073741824
Apr 22 02:40:17 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:18 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 1073741824" returned: 0 in 0.816s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:18 devstack sudo[87593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499
Apr 22 02:40:18 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:19 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499" returned: 0 in 0.511s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a0013c-d8d8-42d1-922d-bef846d3b3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aff830-dc63-4757-a1ef-cac60fa300f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:19 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Volume volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 (9cef12a9-6b04-4229-9cbd-c6b6b9196499): created successfully
Apr 22 02:40:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aff830-dc63-4757-a1ef-cac60fa300f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (cb9c8619-da24-46b4-8e48-2ffad431fb93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:19 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8970051c-7540-4590-a6ab-36a98d373ba0 tempest-VolumesGetTest-1780801094 None] Created volume successfully.
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (d62509f7-e484-43ff-8db1-d3bb7ee49c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5216c6-e7c5-4418-98ca-811b0387816b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5216c6-e7c5-4418-98ca-811b0387816b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2111341706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18b1db9-799a-45ed-b638-a4c56013f3da,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=9cef12a9-6b04-4229-9cbd-c6b6b9196499,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:20Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380ab23a-0787-45c5-a374-69f91f9928b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380ab23a-0787-45c5-a374-69f91f9928b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5730fb-ddca-4f65-97ce-bfd25ce54e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e5730fb-ddca-4f65-97ce-bfd25ce54e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd18b1db9-799a-45ed-b638-a4c56013f3da', 'volume_name': 'volume-d18b1db9-799a-45ed-b638-a4c56013f3da', 'volume_size': 1, 'source_volid': '9cef12a9-6b04-4229-9cbd-c6b6b9196499', 'source_volstatus': 'available'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b1a847-5e03-4b92-9e32-ff56a39f0884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b1a847-5e03-4b92-9e32-ff56a39f0884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806fe82d-de74-48f4-9f7a-cb1dfc491f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:20 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Volume d18b1db9-799a-45ed-b638-a4c56013f3da: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d18b1db9-799a-45ed-b638-a4c56013f3da', 'volume_size': 1, 'source_volid': '9cef12a9-6b04-4229-9cbd-c6b6b9196499', 'source_volstatus': 'available'}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:20 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Cloning volume 9cef12a9-6b04-4229-9cbd-c6b6b9196499 to volume d18b1db9-799a-45ed-b638-a4c56013f3da
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Creating offline snapshot d5c00383-11a7-4c55-81b9-d560088b62ba of volume 9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1d8bcc-1224-4ea9-a3dd-37ef97b8f345]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:20 devstack sudo[87596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499
Apr 22 02:40:20 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:20 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Flow 'volume_create_manager' (4842dd97-14fa-47d1-ab47-3eb78c201a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad28b97-75a1-43f6-9dd9-c10c89fe682a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad28b97-75a1-43f6-9dd9-c10c89fe682a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1545359110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1414cf82-b8c4-49cf-b87d-72e0b076f0c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72580d4c6f05404c91f80efd0bf5c8f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:21Z,use_quota=True,user_id='d2d4ce9fc6f34706a5d8342e073223b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadc2afd-b48f-4982-897a-342d4d5b7457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadc2afd-b48f-4982-897a-342d4d5b7457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77c448f-3be5-4338-913a-81da5b4214e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77c448f-3be5-4338-913a-81da5b4214e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1414cf82-b8c4-49cf-b87d-72e0b076f0c0', 'volume_name': 'volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49372f27-1140-4e83-9b62-366358f9684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49372f27-1140-4e83-9b62-366358f9684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:21 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5283cac0-cfd8-4641-bacb-ba7a34eda05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Volume 1414cf82-b8c4-49cf-b87d-72e0b076f0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0', 'volume_size': 1}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499" returned: 0 in 0.638s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:21 devstack sudo[87601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba 1G
Apr 22 02:40:21 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Flow 'volume_create_manager' (dc30c8c3-1df0-45d8-9ff9-36081710ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:21 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649bd212-2f91-414f-b06a-03c05bf062de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba 1G" returned: 0 in 0.671s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:21 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba
Apr 22 02:40:21 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649bd212-2f91-414f-b06a-03c05bf062de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-472480955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40670d6d-321f-41c2-bdbd-8956527ee37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123e61171d344eff9d0241c8cee9f241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:22Z,use_quota=True,user_id='99a279ccfc6a43aa91d99cc1423731be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087502f1-2297-4ae3-8cbd-ae39965d6d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087502f1-2297-4ae3-8cbd-ae39965d6d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5000b2b-f7d6-4aad-bca9-5fb8039fa631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5000b2b-f7d6-4aad-bca9-5fb8039fa631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40670d6d-321f-41c2-bdbd-8956527ee37f', 'volume_name': 'volume-40670d6d-321f-41c2-bdbd-8956527ee37f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52eb04a2-c777-49cd-969c-bfb9caab29ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52eb04a2-c777-49cd-969c-bfb9caab29ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010a82fd-9406-4024-b4a6-c91f4e206726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Volume 40670d6d-321f-41c2-bdbd-8956527ee37f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40670d6d-321f-41c2-bdbd-8956527ee37f', 'volume_size': 1}
Apr 22 02:40:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:22 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:22 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba is being set with open permissions: ugo+rw
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:22 devstack sudo[87612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba
Apr 22 02:40:22 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Flow 'volume_create_manager' (e4af21d4-a136-41d2-98cb-8d843463efc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b5461c-3a67-4ea1-88cf-84d511bec3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b5461c-3a67-4ea1-88cf-84d511bec3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-132693118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e982a08-8d56-40ef-8e0b-6dc116cb4d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0679b6e53d494339a1c148a1c83da64b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:22Z,use_quota=True,user_id='49b5967eadb44b7c80b30d46f2b3fbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e7c8ae-f4df-4716-ac0d-3a1a84081476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e7c8ae-f4df-4716-ac0d-3a1a84081476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17afc6ae-a620-4699-855c-28467b84d099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17afc6ae-a620-4699-855c-28467b84d099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e982a08-8d56-40ef-8e0b-6dc116cb4d83', 'volume_name': 'volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f74770-beb4-4223-b5de-752af996e267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f74770-beb4-4223-b5de-752af996e267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d650f41b-57f3-4a3f-a317-9e0dae89b640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:22 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Volume 8e982a08-8d56-40ef-8e0b-6dc116cb4d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83', 'volume_size': 1}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:22 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba" returned: 0 in 0.410s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:22 devstack sudo[87615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.info
Apr 22 02:40:22 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:23 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.info" returned: 0 in 0.411s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:23 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.info is being set with open permissions: ugo+rw
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:23 devstack sudo[87618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.info
Apr 22 02:40:23 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:23 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.info" returned: 0 in 0.407s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-d18b1db9-799a-45ed-b638-a4c56013f3da" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-d18b1db9-799a-45ed-b638-a4c56013f3da" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] snapshot: d5c00383-11a7-4c55-81b9-d560088b62ba, volume: d18b1db9-799a-45ed-b638-a4c56013f3da,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dffafe-49a2-4dd0-ac61-630a9c2f3f07]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:23 devstack sudo[87621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba
Apr 22 02:40:23 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:24 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba" returned: 0 in 0.483s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8888281-5f34-40b1-8798-9e9b0278cd7a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:24 devstack sudo[87626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499
Apr 22 02:40:24 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:24 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499" returned: 0 in 0.487s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:40:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:24 devstack sudo[87631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da
Apr 22 02:40:24 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:26 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da" returned: 0 in 2.001s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:26 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[f332c750-b7cf-4078-b906-2d44969fc6fd]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:26 devstack sudo[87643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499
Apr 22 02:40:26 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:27 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499" returned: 0 in 0.573s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:40:27 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Converted 1024.00 MB image at 511.46 MB/s
Apr 22 02:40:27 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da is being set with open permissions: ugo+rw
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:27 devstack sudo[87648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da
Apr 22 02:40:27 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:27 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da" returned: 0 in 0.431s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-d18b1db9-799a-45ed-b638-a4c56013f3da" released by "_copy_volume_from_snapshot" :: held 4.017s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=173,cinder:INSERT=45,cinder:UPDATE=222,cinder:DELETE=8 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-d5c00383-11a7-4c55-81b9-d560088b62ba" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-d5c00383-11a7-4c55-81b9-d560088b62ba" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Deleting offline snapshot d5c00383-11a7-4c55-81b9-d560088b62ba of volume 9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] snapshot_file for this snap is: volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab875086-d322-42d5-a34e-d3702f6b6674]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:27 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba
Apr 22 02:40:27 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:28 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba" returned: 0 in 0.478s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:40:28 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c7a818-4777-4938-80a4-a47313b4abc4]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:28 devstack sudo[87656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499
Apr 22 02:40:28 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:28 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499" returned: 0 in 0.460s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:28 devstack sudo[87661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba
Apr 22 02:40:28 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:28 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba" returned: 0 in 0.443s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:28 devstack sudo[87666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba
Apr 22 02:40:28 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:29 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499.d5c00383-11a7-4c55-81b9-d560088b62ba" returned: 0 in 0.392s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-d5c00383-11a7-4c55-81b9-d560088b62ba" released by "_delete_snapshot" :: held 1.824s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.014s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.323s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1545359110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1414cf82-b8c4-49cf-b87d-72e0b076f0c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72580d4c6f05404c91f80efd0bf5c8f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:21Z,use_quota=True,user_id='d2d4ce9fc6f34706a5d8342e073223b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Creating volume 1414cf82-b8c4-49cf-b87d-72e0b076f0c0 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:29 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806fe82d-de74-48f4-9f7a-cb1dfc491f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18b1db9-799a-45ed-b638-a4c56013f3da', 'volume_size': 1, 'source_volid': '9cef12a9-6b04-4229-9cbd-c6b6b9196499', 'source_volstatus': 'available'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:29 devstack sudo[87669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0 1073741824
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b673be-8280-4367-8c6d-16eddcec4791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:29 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:29 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Volume volume-d18b1db9-799a-45ed-b638-a4c56013f3da (d18b1db9-799a-45ed-b638-a4c56013f3da): created successfully
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b673be-8280-4367-8c6d-16eddcec4791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (d62509f7-e484-43ff-8db1-d3bb7ee49c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:29 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f819ae92-0090-436d-a6ad-55e0fbbe92bb tempest-VolumesGetTest-1780801094 None] Created volume successfully.
Apr 22 02:40:29 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0 1073741824" returned: 0 in 0.513s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:29 devstack sudo[87674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0
Apr 22 02:40:29 devstack sudo[87674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (cb0ba47e-4dd5-4250-b0f0-0782df4a529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14368118-a63d-43a7-8c28-b2bc13799654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14368118-a63d-43a7-8c28-b2bc13799654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-206759958',display_name='tempest-VolumesGetTest-Volume-1540342933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d999c68e-cc5f-4c33-98ca-1470be735982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:30Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71615713-b471-44f6-94a6-e0c2aa0b85f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71615713-b471-44f6-94a6-e0c2aa0b85f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570d1071-e3eb-476e-a404-5535882b69bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570d1071-e3eb-476e-a404-5535882b69bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd999c68e-cc5f-4c33-98ca-1470be735982', 'volume_name': 'volume-d999c68e-cc5f-4c33-98ca-1470be735982', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a248b2-2120-4a79-8fdb-f560525e8489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a248b2-2120-4a79-8fdb-f560525e8489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9118e3-a6d7-4f68-8434-89c4db8c0ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:30 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Volume d999c68e-cc5f-4c33-98ca-1470be735982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d999c68e-cc5f-4c33-98ca-1470be735982', 'volume_size': 1}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:30 devstack sudo[87674]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0" returned: 0 in 0.416s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.559s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-472480955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40670d6d-321f-41c2-bdbd-8956527ee37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123e61171d344eff9d0241c8cee9f241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:22Z,use_quota=True,user_id='99a279ccfc6a43aa91d99cc1423731be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Creating volume 40670d6d-321f-41c2-bdbd-8956527ee37f {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:30 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5283cac0-cfd8-4641-bacb-ba7a34eda05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ad51ea-5f15-405c-a6cb-defce5ba11e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:30 devstack sudo[87677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f 1073741824
Apr 22 02:40:30 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:30 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Volume volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0 (1414cf82-b8c4-49cf-b87d-72e0b076f0c0): created successfully
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ad51ea-5f15-405c-a6cb-defce5ba11e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Flow 'volume_create_manager' (4842dd97-14fa-47d1-ab47-3eb78c201a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:30 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-b18396ef-d91d-4935-a8bc-1734e5e45860 req-e3b71a67-3de5-4838-97d4-0ceaecded7fc tempest-VolumesGetTestJSON-1288351412 None] Created volume successfully.
Apr 22 02:40:30 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f 1073741824" returned: 0 in 0.522s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:30 devstack sudo[87682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f
Apr 22 02:40:30 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Acquiring lock "cinder-1414cf82-b8c4-49cf-b87d-72e0b076f0c0-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Lock "cinder-1414cf82-b8c4-49cf-b87d-72e0b076f0c0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Acquiring lock "cinder-quobyte-1414cf82-b8c4-49cf-b87d-72e0b076f0c0" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Lock "cinder-quobyte-1414cf82-b8c4-49cf-b87d-72e0b076f0c0" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[a096984d-19a2-4694-8d8d-c293958ead61]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:31 devstack sudo[87684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0
Apr 22 02:40:31 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:31 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f" returned: 0 in 0.447s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.836s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-132693118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e982a08-8d56-40ef-8e0b-6dc116cb4d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0679b6e53d494339a1c148a1c83da64b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:22Z,use_quota=True,user_id='49b5967eadb44b7c80b30d46f2b3fbc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Creating volume 8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:31 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010a82fd-9406-4024-b4a6-c91f4e206726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40670d6d-321f-41c2-bdbd-8956527ee37f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:31 devstack sudo[87687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 1073741824
Apr 22 02:40:31 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a00551a-40ce-421f-adff-68967025c1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:31 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Volume volume-40670d6d-321f-41c2-bdbd-8956527ee37f (40670d6d-321f-41c2-bdbd-8956527ee37f): created successfully
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a00551a-40ce-421f-adff-68967025c1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Flow 'volume_create_manager' (dc30c8c3-1df0-45d8-9ff9-36081710ae47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-105d9de1-329b-4f7f-9b6c-2f4b38439817 tempest-VolumeQuotasAdminTestJSON-65842391 None] Created volume successfully.
Apr 22 02:40:31 devstack sudo[87692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:31 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:31 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0" returned: 0 in 0.484s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:31 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0
Apr 22 02:40:31 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:31 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 1073741824" returned: 0 in 0.464s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:31 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.453s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:31 devstack sudo[87702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:40:31 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:31 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1414cf82-b8c4-49cf-b87d-72e0b076f0c0" returned: 0 in 0.456s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Lock "cinder-quobyte-1414cf82-b8c4-49cf-b87d-72e0b076f0c0" released by "delete_volume" :: held 0.961s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:31 devstack cinder-volume[82678]: DEBUG cinder.quota [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Created reservations ['41a7f73f-9f78-4733-b441-f11844ed50be', 'c1761986-28cc-46c4-a847-79bb9a7197e4', '2f4c7995-d1bd-4d35-8205-60f13758061f', 'dc41bbd0-0593-4fd4-9583-bfb3c38c3703'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:32 devstack sudo[87704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:32 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:32 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Acquiring lock "cinder-40670d6d-321f-41c2-bdbd-8956527ee37f-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.472s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.188s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-206759958',display_name='tempest-VolumesGetTest-Volume-1540342933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d999c68e-cc5f-4c33-98ca-1470be735982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:30Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Creating volume d999c68e-cc5f-4c33-98ca-1470be735982 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:32 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d650f41b-57f3-4a3f-a317-9e0dae89b640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:32 devstack sudo[87707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982 1073741824
Apr 22 02:40:32 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a2f852-7b77-4dc3-b249-0d9a3fd617f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "cinder-40670d6d-321f-41c2-bdbd-8956527ee37f-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:32 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Volume volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 (8e982a08-8d56-40ef-8e0b-6dc116cb4d83): created successfully
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a2f852-7b77-4dc3-b249-0d9a3fd617f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Flow 'volume_create_manager' (e4af21d4-a136-41d2-98cb-8d843463efc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:32 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ff759b7c-f96a-410f-bbe8-8c3a6eb95ca3 tempest-VolumesActionsTest-160873546 None] Created volume successfully.
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Acquiring lock "cinder-quobyte-40670d6d-321f-41c2-bdbd-8956527ee37f" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "cinder-quobyte-40670d6d-321f-41c2-bdbd-8956527ee37f" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44532ce-c616-45f9-b29e-8ab5fbf783ad]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:32 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f
Apr 22 02:40:32 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:32 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.506s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.manager [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:32 devstack cinder-volume[82678]: INFO cinder.volume.manager [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Deleted volume successfully.
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [req-d88849f4-5871-473f-ac08-6264475632e0 req-de65251d-4405-430a-a75c-8c715d98a9b6 tempest-VolumesGetTestJSON-1288351412 None] Lock "cinder-1414cf82-b8c4-49cf-b87d-72e0b076f0c0-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:32 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982 1073741824" returned: 0 in 0.506s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:32 devstack sudo[87715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982
Apr 22 02:40:32 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:33 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f" returned: 0 in 0.599s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:33 devstack sudo[87720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f
Apr 22 02:40:33 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:33 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982" returned: 0 in 0.560s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9118e3-a6d7-4f68-8434-89c4db8c0ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d999c68e-cc5f-4c33-98ca-1470be735982', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c2d770-8066-4e99-8f23-3865a61a6e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:33 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Volume volume-d999c68e-cc5f-4c33-98ca-1470be735982 (d999c68e-cc5f-4c33-98ca-1470be735982): created successfully
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c2d770-8066-4e99-8f23-3865a61a6e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (cb0ba47e-4dd5-4250-b0f0-0782df4a529f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:33 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-078e1d21-5e1d-488b-a78c-eb62a6e489e5 tempest-VolumesGetTest-1780801094 None] Created volume successfully.
Apr 22 02:40:33 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-40670d6d-321f-41c2-bdbd-8956527ee37f" returned: 0 in 0.532s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "cinder-quobyte-40670d6d-321f-41c2-bdbd-8956527ee37f" released by "delete_volume" :: held 1.164s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Created reservations ['e68e3ec7-3b45-46e6-b421-ad4440be6e95', 'e122024f-1d33-495a-9cd1-a7798a5e091e', 'f33565b4-3187-4b4b-b7b3-368e75508e6d', 'dce804d5-04b5-454f-85eb-6a8946d4bbc5'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:33 devstack sudo[87727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:33 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:34 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.481s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:34 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Deleted volume successfully.
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd52509f-e24e-4058-9441-ba7ceae31ffe tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "cinder-40670d6d-321f-41c2-bdbd-8956527ee37f-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-d999c68e-cc5f-4c33-98ca-1470be735982-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Lock "cinder-d999c68e-cc5f-4c33-98ca-1470be735982-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-d999c68e-cc5f-4c33-98ca-1470be735982" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-d999c68e-cc5f-4c33-98ca-1470be735982" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd1c5af-6230-43fd-bd3f-f4982ed7a3a0]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:34 devstack sudo[87731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982
Apr 22 02:40:34 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Flow 'volume_create_manager' (6c9e52ce-326c-49d3-9033-df05524ad1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63584ba-55ab-4b6e-919b-063cdeb0b1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b63584ba-55ab-4b6e-919b-063cdeb0b1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2002016940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a985aa-541f-4b49-b62a-9cf2525b86e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8990e72a6a7b422a88f3e55f3edae8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:35Z,use_quota=True,user_id='572c4977cdb645878699fa6e5c150aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0d82fa-87a9-405e-86ab-0bbf6058c8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0d82fa-87a9-405e-86ab-0bbf6058c8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0410750-3543-4ada-bdeb-2a1d73702337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0410750-3543-4ada-bdeb-2a1d73702337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23a985aa-541f-4b49-b62a-9cf2525b86e0', 'volume_name': 'volume-23a985aa-541f-4b49-b62a-9cf2525b86e0', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74994b51-3f6b-4768-83f4-a395bd2c2dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74994b51-3f6b-4768-83f4-a395bd2c2dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87711e0-f69c-49b9-875e-f740c415369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Volume 23a985aa-541f-4b49-b62a-9cf2525b86e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23a985aa-541f-4b49-b62a-9cf2525b86e0', 'volume_size': 1}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2002016940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23a985aa-541f-4b49-b62a-9cf2525b86e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8990e72a6a7b422a88f3e55f3edae8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:35Z,use_quota=True,user_id='572c4977cdb645878699fa6e5c150aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Creating volume 23a985aa-541f-4b49-b62a-9cf2525b86e0 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:34 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:34 devstack sudo[87733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0 1073741824
Apr 22 02:40:34 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Flow 'volume_create_manager' (89e6ac69-164b-4696-bab6-14a5f86983ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83874feb-28de-4cdb-9740-d8126a198857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83874feb-28de-4cdb-9740-d8126a198857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-442876749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e918c7b8-fa57-469a-9fc7-c9f20ea11f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123e61171d344eff9d0241c8cee9f241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:35Z,use_quota=True,user_id='99a279ccfc6a43aa91d99cc1423731be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4587b793-48d4-4ad5-aaad-f206ea8f2b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4587b793-48d4-4ad5-aaad-f206ea8f2b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6585e400-252a-4fee-8746-561641f469f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6585e400-252a-4fee-8746-561641f469f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e918c7b8-fa57-469a-9fc7-c9f20ea11f3e', 'volume_name': 'volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920f7a8f-712d-4908-93e5-7ee2f98e1cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (920f7a8f-712d-4908-93e5-7ee2f98e1cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d807de04-df57-4210-a218-b9fcd5ac814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:34 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Volume e918c7b8-fa57-469a-9fc7-c9f20ea11f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e', 'volume_size': 1}
Apr 22 02:40:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:35 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982" returned: 0 in 0.573s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:35 devstack sudo[87738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982
Apr 22 02:40:35 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:35 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0 1073741824" returned: 0 in 0.519s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:35 devstack sudo[87743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0
Apr 22 02:40:35 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:35 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d999c68e-cc5f-4c33-98ca-1470be735982" returned: 0 in 0.465s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-d999c68e-cc5f-4c33-98ca-1470be735982" released by "delete_volume" :: held 1.061s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Created reservations ['79465c05-517e-4aca-943a-b0b07af58673', '7cfe4236-1572-4e3b-8e8f-75522d587bd4', '77dfab9f-24a2-4cca-8ed5-7d4abadbf972', '3935b37b-5b2f-4dcd-8be8-2745ba8d43b5'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:35 devstack sudo[87746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:35 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:35 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0" returned: 0 in 0.451s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-442876749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e918c7b8-fa57-469a-9fc7-c9f20ea11f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123e61171d344eff9d0241c8cee9f241',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:35Z,use_quota=True,user_id='99a279ccfc6a43aa91d99cc1423731be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Creating volume e918c7b8-fa57-469a-9fc7-c9f20ea11f3e {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:35 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87711e0-f69c-49b9-875e-f740c415369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23a985aa-541f-4b49-b62a-9cf2525b86e0', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:35 devstack sudo[87749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e 1073741824
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0481bf1e-3b08-4112-bbec-c6a04d86a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:35 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:35 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Volume volume-23a985aa-541f-4b49-b62a-9cf2525b86e0 (23a985aa-541f-4b49-b62a-9cf2525b86e0): created successfully
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0481bf1e-3b08-4112-bbec-c6a04d86a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Flow 'volume_create_manager' (6c9e52ce-326c-49d3-9033-df05524ad1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8405d04d-389d-438d-ab92-7486f45c18c0 tempest-VolumesTestJSON-2003157551 None] Created volume successfully.
Apr 22 02:40:36 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.428s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:36 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Deleted volume successfully.
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-05758fbe-7c68-4d3d-9675-931ec30acc0d tempest-VolumesGetTest-1780801094 None] Lock "cinder-d999c68e-cc5f-4c33-98ca-1470be735982-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:36 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e 1073741824" returned: 0 in 0.541s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:36 devstack sudo[87755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e
Apr 22 02:40:36 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-d18b1db9-799a-45ed-b638-a4c56013f3da-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Lock "cinder-d18b1db9-799a-45ed-b638-a4c56013f3da-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-d18b1db9-799a-45ed-b638-a4c56013f3da" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-d18b1db9-799a-45ed-b638-a4c56013f3da" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba5b189-8d7f-4cf0-94ae-768d0bf21f5a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:36 devstack sudo[87757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da
Apr 22 02:40:36 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:36 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d807de04-df57-4210-a218-b9fcd5ac814c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffeb2303-cf97-4e8b-9013-6221221151a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:36 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Volume volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e (e918c7b8-fa57-469a-9fc7-c9f20ea11f3e): created successfully
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffeb2303-cf97-4e8b-9013-6221221151a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Flow 'volume_create_manager' (89e6ac69-164b-4696-bab6-14a5f86983ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:36 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d735eb66-0020-4141-9e15-10c1d5487fab tempest-VolumeQuotasAdminTestJSON-65842391 None] Created volume successfully.
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Flow 'volume_create_manager' (f0de56af-05d1-4735-af7f-9671a51f4e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81dbcd62-9f72-4ce5-b23e-2bab64a4e973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81dbcd62-9f72-4ce5-b23e-2bab64a4e973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1475322989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242f26cf-7b5d-45f5-b746-1a5952ea63fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8990e72a6a7b422a88f3e55f3edae8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:37Z,use_quota=True,user_id='572c4977cdb645878699fa6e5c150aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72a9514-d26e-49cd-87c4-3bd53640dac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72a9514-d26e-49cd-87c4-3bd53640dac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484e22a3-1f34-4edd-b1d8-e533ccfc24e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484e22a3-1f34-4edd-b1d8-e533ccfc24e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242f26cf-7b5d-45f5-b746-1a5952ea63fe', 'volume_name': 'volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27b477d-01e2-4c7f-928c-f4c8641b9817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27b477d-01e2-4c7f-928c-f4c8641b9817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1128ada9-ef4c-4f42-b842-723a594a3a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:37 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Volume 242f26cf-7b5d-45f5-b746-1a5952ea63fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe', 'volume_size': 1}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1475322989',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242f26cf-7b5d-45f5-b746-1a5952ea63fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8990e72a6a7b422a88f3e55f3edae8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:37Z,use_quota=True,user_id='572c4977cdb645878699fa6e5c150aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Creating volume 242f26cf-7b5d-45f5-b746-1a5952ea63fe {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:37 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:37 devstack sudo[87760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe 1073741824
Apr 22 02:40:37 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:37 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da" returned: 0 in 0.572s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:37 devstack sudo[87765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da
Apr 22 02:40:37 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:37 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c4640c6a-2d94-423f-9d84-748c67d71709 tempest-VolumeQuotasAdminTestJSON-1454602757 None] Transfer volume completed successfully.
Apr 22 02:40:37 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe 1073741824" returned: 0 in 0.579s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:37 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:37 devstack sudo[87772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d18b1db9-799a-45ed-b638-a4c56013f3da" returned: 0 in 0.485s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:37 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-d18b1db9-799a-45ed-b638-a4c56013f3da" released by "delete_volume" :: held 1.079s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Created reservations ['4508a748-e0db-4594-9615-597ee20200c5', '92b31871-9a50-4ffd-ad88-a73dd78edb96', '018deff6-abf7-4813-845a-aee67e21d15c', '5a33023f-ad6b-48f1-b418-f32156370b95'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:37 devstack sudo[87774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:37 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Acquiring lock "cinder-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Lock "cinder-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Acquiring lock "cinder-quobyte-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Lock "cinder-quobyte-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e" acquired by "delete_volume" :: waited 0.023s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac909da-c3cf-4972-bbcd-b66405278b27]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:38 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe" returned: 0 in 0.532s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1128ada9-ef4c-4f42-b842-723a594a3a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d2149c-5742-48a1-b287-2dbe0c032076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:38 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Volume volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe (242f26cf-7b5d-45f5-b746-1a5952ea63fe): created successfully
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d2149c-5742-48a1-b287-2dbe0c032076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Flow 'volume_create_manager' (f0de56af-05d1-4735-af7f-9671a51f4e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:38 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4faf4678-ca80-4184-91c4-c784380b6315 tempest-VolumesTestJSON-2003157551 None] Created volume successfully.
Apr 22 02:40:38 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e
Apr 22 02:40:38 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:38 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.564s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:38 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Deleted volume successfully.
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-90914363-f58d-4cc3-b027-33e53c94ef21 tempest-VolumesGetTest-1780801094 None] Lock "cinder-d18b1db9-799a-45ed-b638-a4c56013f3da-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:38 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e" returned: 0 in 0.600s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:38 devstack sudo[87783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e
Apr 22 02:40:38 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-9cef12a9-6b04-4229-9cbd-c6b6b9196499-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Lock "cinder-9cef12a9-6b04-4229-9cbd-c6b6b9196499-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-9cef12a9-6b04-4229-9cbd-c6b6b9196499" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-9cef12a9-6b04-4229-9cbd-c6b6b9196499" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c42ff5-7148-49b6-b6ec-e053c48e3f63]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:39 devstack sudo[87785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499
Apr 22 02:40:39 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:39 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e" returned: 0 in 0.636s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Lock "cinder-quobyte-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e" released by "delete_volume" :: held 1.288s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Created reservations ['19cd5a78-a5a7-4254-a4c2-3722e74b4c98', '0b0902cc-8491-4dbe-a04e-f1b726f685a6', '260a8759-be02-4b09-8c99-5436bbab0b96', '125e35be-c205-40e9-a361-07dbde4b1ad7'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:39 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Flow 'volume_create_manager' (b2385389-0476-4a5f-ab50-631fb65a44ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff83231-4eb1-4b82-99e2-5654c6afc6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499" returned: 0 in 0.692s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff83231-4eb1-4b82-99e2-5654c6afc6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-575652107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a362be-567a-4867-b05c-eb8fc13ca7a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8990e72a6a7b422a88f3e55f3edae8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:40Z,use_quota=True,user_id='572c4977cdb645878699fa6e5c150aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:39 devstack sudo[87792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499
Apr 22 02:40:39 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d518307-6986-40c9-8d04-8d8874fcbd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d518307-6986-40c9-8d04-8d8874fcbd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7bcab7-6434-42d7-9d3d-6741e4956653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7bcab7-6434-42d7-9d3d-6741e4956653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a362be-567a-4867-b05c-eb8fc13ca7a4', 'volume_name': 'volume-93a362be-567a-4867-b05c-eb8fc13ca7a4', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fff60e-da7c-4745-991a-78963786ff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0fff60e-da7c-4745-991a-78963786ff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b38cfe5-51da-4b4c-8b75-1cba70cc18a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:39 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Volume 93a362be-567a-4867-b05c-eb8fc13ca7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a362be-567a-4867-b05c-eb8fc13ca7a4', 'volume_size': 1}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-575652107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a362be-567a-4867-b05c-eb8fc13ca7a4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8990e72a6a7b422a88f3e55f3edae8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:40Z,use_quota=True,user_id='572c4977cdb645878699fa6e5c150aee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Creating volume 93a362be-567a-4867-b05c-eb8fc13ca7a4 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:39 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:39 devstack sudo[87794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4 1073741824
Apr 22 02:40:39 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:39 devstack sudo[87796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:39 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:40 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9cef12a9-6b04-4229-9cbd-c6b6b9196499" returned: 0 in 0.425s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-9cef12a9-6b04-4229-9cbd-c6b6b9196499" released by "delete_volume" :: held 1.147s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Created reservations ['74784cf5-af10-42b1-b12a-26c8afd8f22f', '1a6219c7-3ba5-4c3b-9d11-2f513b75516b', '00ad516a-87a4-4595-b803-cd35f020ead7', '0c76dbd7-12d9-4739-9c83-336973b1542f'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:40 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:40 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Deleted volume successfully.
Apr 22 02:40:40 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:40 devstack sudo[87806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4 1073741824" returned: 0 in 0.524s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:40 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ea24f9-c979-4122-a6c0-94f6361342e5 tempest-VolumeQuotasAdminTestJSON-259619643 None] Lock "cinder-e918c7b8-fa57-469a-9fc7-c9f20ea11f3e-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:40 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4
Apr 22 02:40:40 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:40 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.549s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:40 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Deleted volume successfully.
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-127024d2-9ed7-43ac-838d-2245bae9263f tempest-VolumesGetTest-1780801094 None] Lock "cinder-9cef12a9-6b04-4229-9cbd-c6b6b9196499-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:40 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4" returned: 0 in 0.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b38cfe5-51da-4b4c-8b75-1cba70cc18a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a362be-567a-4867-b05c-eb8fc13ca7a4', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21861d79-84ac-4019-bbb9-f0cd3346b6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:40 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Volume volume-93a362be-567a-4867-b05c-eb8fc13ca7a4 (93a362be-567a-4867-b05c-eb8fc13ca7a4): created successfully
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21861d79-84ac-4019-bbb9-f0cd3346b6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Flow 'volume_create_manager' (b2385389-0476-4a5f-ab50-631fb65a44ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:40 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3f6a5a7b-f234-43e0-99c5-9417dc168de7 tempest-VolumesTestJSON-2003157551 None] Created volume successfully.
Apr 22 02:40:41 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (703d5285-1ee2-4352-a0db-abc7fc5db69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ef22fb-5923-48ec-92e7-444b50059cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ef22fb-5923-48ec-92e7-444b50059cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-54717369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1f5490-4621-44db-8907-bee2d930ffe2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:42Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb2cc0f-d226-477d-8c13-0b61d95580e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb2cc0f-d226-477d-8c13-0b61d95580e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde8f6cf-0ee0-496d-9cb9-480a8d7af703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:41 devstack cinder-volume[82678]: DEBUG cinder.image.glance [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Creating Keystone auth plugin from conf {{(pid=82678) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde8f6cf-0ee0-496d-9cb9-480a8d7af703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ca1f5490-4621-44db-8907-bee2d930ffe2', 'volume_name': 'volume-ca1f5490-4621-44db-8907-bee2d930ffe2', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6970ea0040>}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d374cf77-6081-43d5-bea5-4513acf9e421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d374cf77-6081-43d5-bea5-4513acf9e421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6124713-6a51-43b4-81f8-cab909c414d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:42 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Volume ca1f5490-4621-44db-8907-bee2d930ffe2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ca1f5490-4621-44db-8907-bee2d930ffe2', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6970ea0040>}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Trying to clone ca1f5490-4621-44db-8907-bee2d930ffe2 from image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]). {{(pid=82678) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 22 02:40:42 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Image download 20.69 MB at 20.69 MB/s
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a4e8d-8633-4bf0-8093-28f2e5503396]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:42 devstack sudo[87826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD
Apr 22 02:40:42 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "cinder-93a362be-567a-4867-b05c-eb8fc13ca7a4-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-93a362be-567a-4867-b05c-eb8fc13ca7a4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "cinder-quobyte-93a362be-567a-4867-b05c-eb8fc13ca7a4" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-quobyte-93a362be-567a-4867-b05c-eb8fc13ca7a4" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[363b765c-411c-42b9-b3fa-dc69b3617e1c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:42 devstack sudo[87828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4
Apr 22 02:40:42 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:42 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD" returned: 0 in 0.572s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:42 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Temporary image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 is fetched for user de0f5c85fb5c485fbaac00de9f71214e. {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee54533b-fd45-4441-9a5d-fe06688a435d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:43 devstack sudo[87836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD
Apr 22 02:40:43 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:43 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4" returned: 0 in 0.661s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:43 devstack sudo[87841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4
Apr 22 02:40:43 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:43 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD" returned: 0 in 0.591s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-54717369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca1f5490-4621-44db-8907-bee2d930ffe2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:42Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Creating volume ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:43 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:43 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 1073741824
Apr 22 02:40:43 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:43 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-93a362be-567a-4867-b05c-eb8fc13ca7a4" returned: 0 in 0.441s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-quobyte-93a362be-567a-4867-b05c-eb8fc13ca7a4" released by "delete_volume" :: held 1.125s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Created reservations ['8af3dfdd-e6d4-42c5-8333-359af8ca2282', 'ebf86462-afa1-4957-9fb5-53da91f94661', '450d36c6-e2f4-4745-94ab-f5774090a6e4', '780d7e41-5d36-4706-a01c-84c4e13a95ae'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:43 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:43 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:44 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 1073741824" returned: 0 in 0.564s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:44 devstack sudo[87854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2
Apr 22 02:40:44 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:44 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:44 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Deleted volume successfully.
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9bd15d45-9f57-4d43-b0a1-0824ef7a26a7 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-93a362be-567a-4867-b05c-eb8fc13ca7a4-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "cinder-242f26cf-7b5d-45f5-b746-1a5952ea63fe-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-242f26cf-7b5d-45f5-b746-1a5952ea63fe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "cinder-quobyte-242f26cf-7b5d-45f5-b746-1a5952ea63fe" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-quobyte-242f26cf-7b5d-45f5-b746-1a5952ea63fe" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c2aad8-e760-4f33-9c78-ba687d4ccd1f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:45 devstack sudo[87884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe
Apr 22 02:40:45 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:45 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2" returned: 0 in 0.841s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Attempting download of a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}])) to volume ca1f5490-4621-44db-8907-bee2d930ffe2. {{(pid=82678) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fc41bf-b020-4100-988d-4c9a1fbd03a5]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_b5bm0thn {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:45 devstack sudo[87887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_b5bm0thn
Apr 22 02:40:45 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Flow 'volume_create_manager' (88d530b3-1eb8-4ed4-bd36-83278a597c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b01373d-3b21-456d-908f-8dffba565bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b01373d-3b21-456d-908f-8dffba565bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-892233857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf9b96b-a2a7-460a-b52d-9b7c0868c585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43979868aa434a24a3c5dd83c5229d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:45Z,use_quota=True,user_id='44bc16afda7940ce868630e3fbad44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de893fdd-2d71-46fc-9cee-14b78785ce5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de893fdd-2d71-46fc-9cee-14b78785ce5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8047e37-5aff-4802-8363-99f0dc2e7058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8047e37-5aff-4802-8363-99f0dc2e7058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf9b96b-a2a7-460a-b52d-9b7c0868c585', 'volume_name': 'volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d4ca9c-433a-4bdf-846b-b237085c2169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6d4ca9c-433a-4bdf-846b-b237085c2169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06ed75d-635c-4851-9ab8-c4aafce746cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:45 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Volume acf9b96b-a2a7-460a-b52d-9b7c0868c585: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585', 'volume_size': 1}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-892233857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf9b96b-a2a7-460a-b52d-9b7c0868c585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43979868aa434a24a3c5dd83c5229d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:45Z,use_quota=True,user_id='44bc16afda7940ce868630e3fbad44ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Creating volume acf9b96b-a2a7-460a-b52d-9b7c0868c585 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:45 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:45 devstack sudo[87896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 1073741824
Apr 22 02:40:45 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:45 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe" returned: 0 in 0.822s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:45 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_b5bm0thn" returned: 0 in 0.620s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_b5bm0thn {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:45 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe
Apr 22 02:40:45 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:45 devstack sudo[87900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_b5bm0thn
Apr 22 02:40:45 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:46 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 1073741824" returned: 0 in 0.635s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:46 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585
Apr 22 02:40:46 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:46 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-242f26cf-7b5d-45f5-b746-1a5952ea63fe" returned: 0 in 0.621s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-quobyte-242f26cf-7b5d-45f5-b746-1a5952ea63fe" released by "delete_volume" :: held 1.483s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Created reservations ['41f2d517-76d2-4528-941e-a65427b4997c', '2dbc962b-f1a4-41a5-b80a-a0f96499284d', '8f905000-6d56-4433-8a7f-6f2007faf408', 'f44c6b89-4637-422d-b46d-d1208a518b9d'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:46 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_b5bm0thn" returned: 1 in 0.678s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_b5bm0thn' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f66ef1-2c3a-4b15-a7fc-0a4930d98122]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:46 devstack sudo[87911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:46 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:46 devstack sudo[87912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD
Apr 22 02:40:46 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:46 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585" returned: 0 in 0.476s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06ed75d-635c-4851-9ab8-c4aafce746cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbbde5e-3c37-43e7-9f25-169353494ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:46 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Volume volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 (acf9b96b-a2a7-460a-b52d-9b7c0868c585): created successfully
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbbde5e-3c37-43e7-9f25-169353494ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Flow 'volume_create_manager' (88d530b3-1eb8-4ed4-bd36-83278a597c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:46 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f72f47af-02a3-4bd8-adc6-4f885c466bb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Created volume successfully.
Apr 22 02:40:46 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.538s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Deleted volume successfully.
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-880e78fa-ed09-4e8a-8c6b-28e0cb7ff823 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-242f26cf-7b5d-45f5-b746-1a5952ea63fe-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:47 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD" returned: 0 in 0.565s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 was qcow2, converting to raw {{(pid=82678) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "cinder-23a985aa-541f-4b49-b62a-9cf2525b86e0-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:47 devstack sudo[87920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2
Apr 22 02:40:47 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-23a985aa-541f-4b49-b62a-9cf2525b86e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "cinder-quobyte-23a985aa-541f-4b49-b62a-9cf2525b86e0" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-quobyte-23a985aa-541f-4b49-b62a-9cf2525b86e0" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[165130e5-6f00-4fd5-b0eb-12eb604bfb45]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5c35ced5-1c33-4444-85f0-efe17c719bf8 tempest-VolumesActionsTest-160873546 None] Acquiring lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" by "attach_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5c35ced5-1c33-4444-85f0-efe17c719bf8 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" acquired by "attach_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5c35ced5-1c33-4444-85f0-efe17c719bf8 tempest-VolumesActionsTest-160873546 None] Attaching volume 8e982a08-8d56-40ef-8e0b-6dc116cb4d83 to instance 8ca1aa92-9506-498e-961e-0eaf1319f29f at mountpoint /dev/vdb on host None.
Apr 22 02:40:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5c35ced5-1c33-4444-85f0-efe17c719bf8 tempest-VolumesActionsTest-160873546 None] Attach volume completed successfully.
Apr 22 02:40:47 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0
Apr 22 02:40:47 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5c35ced5-1c33-4444-85f0-efe17c719bf8 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" released by "attach_volume" :: held 0.067s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:47 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0" returned: 0 in 0.626s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:47 devstack sudo[87943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0
Apr 22 02:40:47 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-07a0f24f-9372-40bc-9501-2c306c92e456 tempest-VolumesActionsTest-160873546 None] Acquiring lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-detach_volume" by "detach_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-07a0f24f-9372-40bc-9501-2c306c92e456 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-07a0f24f-9372-40bc-9501-2c306c92e456 tempest-VolumesActionsTest-160873546 None] Detaching volume 8e982a08-8d56-40ef-8e0b-6dc116cb4d83 from instance 8ca1aa92-9506-498e-961e-0eaf1319f29f.
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Creating offline snapshot b2586d01-cca4-419d-92ac-76422ccb0c97 of volume acf9b96b-a2a7-460a-b52d-9b7c0868c585 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec2ddd-9148-4397-a76f-404588a3b5ec]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-07a0f24f-9372-40bc-9501-2c306c92e456 tempest-VolumesActionsTest-160873546 None] Detach volume completed successfully.
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-07a0f24f-9372-40bc-9501-2c306c92e456 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:48 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2" returned: 0 in 1.005s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qgq9fb4qdevstack@QuobyteHD, size 112.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:40:48 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Converted 112.00 MB image at 111.36 MB/s
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:48 devstack sudo[87946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 1G
Apr 22 02:40:48 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:48 devstack sudo[87945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585
Apr 22 02:40:48 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:48 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23a985aa-541f-4b49-b62a-9cf2525b86e0" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-quobyte-23a985aa-541f-4b49-b62a-9cf2525b86e0" released by "delete_volume" :: held 1.159s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Created reservations ['70a8bb13-1bf4-45d3-ab92-cf9682e40b90', '8f61ca01-7df8-4933-b0be-59b8db40cae8', '1b382d3c-bee3-4bea-ae02-f355ad3ac059', '6b37c578-bfa7-438a-aeac-17ce73a5d196'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:48 devstack sudo[87951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:48 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:48 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585" returned: 0 in 0.687s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:48 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 1G
Apr 22 02:40:48 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:48 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 1G" returned: 0 in 0.630s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c919662-20b0-4390-a1b9-29da5496d60b]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:48 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2
Apr 22 02:40:48 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:49 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.597s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:49 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Deleted volume successfully.
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-24af43cb-0ce4-4ff2-a4a6-d32a132b0c41 tempest-VolumesTestJSON-2003157551 None] Lock "cinder-23a985aa-541f-4b49-b62a-9cf2525b86e0-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:49 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 1G" returned: 0 in 0.568s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:49 devstack sudo[87969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97
Apr 22 02:40:49 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:49 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2" returned: 0 in 0.575s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:49 devstack sudo[87971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2
Apr 22 02:40:49 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:49 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97" returned: 0 in 0.591s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:49 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 is being set with open permissions: ugo+rw
Apr 22 02:40:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:49 devstack sudo[87989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97
Apr 22 02:40:49 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:50 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2" returned: 1 in 0.730s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Downloaded image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}])) to volume ca1f5490-4621-44db-8907-bee2d930ffe2 successfully. {{(pid=82678) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Temporary image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 for user de0f5c85fb5c485fbaac00de9f71214e is deleted. {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Marking volume ca1f5490-4621-44db-8907-bee2d930ffe2 as bootable. {{(pid=82678) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Copying metadata from image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 to ca1f5490-4621-44db-8907-bee2d930ffe2. {{(pid=82678) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Creating volume glance metadata for volume ca1f5490-4621-44db-8907-bee2d930ffe2 backed by image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82678) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6124713-6a51-43b4-81f8-cab909c414d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca1f5490-4621-44db-8907-bee2d930ffe2', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6970ea0040>}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e6f701-9b52-4ea5-ada9-0a9859241cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:50 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Volume volume-ca1f5490-4621-44db-8907-bee2d930ffe2 (ca1f5490-4621-44db-8907-bee2d930ffe2): created successfully
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e6f701-9b52-4ea5-ada9-0a9859241cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (703d5285-1ee2-4352-a0db-abc7fc5db69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:50 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4a7549f6-c254-4660-9ab0-c592674da595 tempest-VolumesGetTest-1780801094 None] Created volume successfully.
Apr 22 02:40:50 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97" returned: 0 in 0.621s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:50 devstack sudo[88011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.info
Apr 22 02:40:50 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (8fec7a8d-6796-4424-98c6-636c7058c03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaacdc81-28b3-42fb-a3f7-607a82d3d2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:50 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.info" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaacdc81-28b3-42fb-a3f7-607a82d3d2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2057956546',display_name='tempest-VolumesGetTest-Volume-317089280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687367f6-62d7-4d03-93d7-9beab4e95410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:51Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90641de3-665c-4e6f-be3f-0267b847e328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90641de3-665c-4e6f-be3f-0267b847e328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5890750f-ca6a-4fea-bc0b-b1283dcb69e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5890750f-ca6a-4fea-bc0b-b1283dcb69e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '687367f6-62d7-4d03-93d7-9beab4e95410', 'volume_name': 'volume-687367f6-62d7-4d03-93d7-9beab4e95410', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5c8263-6a47-492a-80f8-e91508615c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5c8263-6a47-492a-80f8-e91508615c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47457a25-8b7d-4ad8-ae93-cdd67b2c1cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:50 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Volume 687367f6-62d7-4d03-93d7-9beab4e95410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-687367f6-62d7-4d03-93d7-9beab4e95410', 'volume_size': 1}
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:50 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.info is being set with open permissions: ugo+rw
Apr 22 02:40:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:50 devstack sudo[88015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.info
Apr 22 02:40:50 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:51 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.info" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.559s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2057956546',display_name='tempest-VolumesGetTest-Volume-317089280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687367f6-62d7-4d03-93d7-9beab4e95410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='922741b955184b54926b9be3c52a8d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:40:51Z,use_quota=True,user_id='de0f5c85fb5c485fbaac00de9f71214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Creating volume 687367f6-62d7-4d03-93d7-9beab4e95410 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:51 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:51 devstack sudo[88019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410 1073741824
Apr 22 02:40:51 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:51 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-34434d65-d69e-4676-873a-9e69b42ca310 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Create snapshot completed successfully
Apr 22 02:40:52 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410 1073741824" returned: 0 in 0.522s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:52 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410
Apr 22 02:40:52 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "cinder-b2586d01-cca4-419d-92ac-76422ccb0c97-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-b2586d01-cca4-419d-92ac-76422ccb0c97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "cinder-quobyte-acf9b96b-a2a7-460a-b52d-9b7c0868c585" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-quobyte-acf9b96b-a2a7-460a-b52d-9b7c0868c585" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "cinder-quobyte-b2586d01-cca4-419d-92ac-76422ccb0c97" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-quobyte-b2586d01-cca4-419d-92ac-76422ccb0c97" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Deleting offline snapshot b2586d01-cca4-419d-92ac-76422ccb0c97 of volume acf9b96b-a2a7-460a-b52d-9b7c0868c585 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] snapshot_file for this snap is: volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd4400f-b485-4938-9ada-fa537e74625a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:52 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97
Apr 22 02:40:52 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:52 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410" returned: 0 in 0.466s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47457a25-8b7d-4ad8-ae93-cdd67b2c1cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687367f6-62d7-4d03-93d7-9beab4e95410', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3085841f-291b-4cda-a66c-32739b2c9efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Volume volume-687367f6-62d7-4d03-93d7-9beab4e95410 (687367f6-62d7-4d03-93d7-9beab4e95410): created successfully
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3085841f-291b-4cda-a66c-32739b2c9efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Flow 'volume_create_manager' (8fec7a8d-6796-4424-98c6-636c7058c03c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9014af2f-0042-4b21-96e5-05a54110ddb9 tempest-VolumesGetTest-1780801094 None] Created volume successfully.
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-db979954-a11a-49df-93e0-60200301db4f tempest-BackendsCapabilitiesAdminTestsJSON-1379181187 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82678) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 22 02:40:52 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97" returned: 0 in 0.495s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f123a5e-11cb-492b-93e5-7573d0a074b9]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:52 devstack sudo[88034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585
Apr 22 02:40:52 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-687367f6-62d7-4d03-93d7-9beab4e95410-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Lock "cinder-687367f6-62d7-4d03-93d7-9beab4e95410-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-687367f6-62d7-4d03-93d7-9beab4e95410" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-687367f6-62d7-4d03-93d7-9beab4e95410" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce277a1e-32d0-4022-be52-e08846259bbc]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:53 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410
Apr 22 02:40:53 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-31c3f2c5-89bc-476b-84ef-122b8a89c35b tempest-BackendsCapabilitiesAdminTestsJSON-1379181187 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82678) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 22 02:40:53 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585" returned: 0 in 0.519s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:53 devstack sudo[88041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97
Apr 22 02:40:53 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:53 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:53 devstack sudo[88046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410
Apr 22 02:40:53 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:53 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97" returned: 0 in 0.490s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:53 devstack sudo[88051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97
Apr 22 02:40:53 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:54 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-687367f6-62d7-4d03-93d7-9beab4e95410" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-687367f6-62d7-4d03-93d7-9beab4e95410" released by "delete_volume" :: held 1.033s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Created reservations ['688a5beb-1988-4bdf-8d22-c0b85f38132f', '919830f2-3f86-4ff4-b1b9-33bbfb014308', '8b37c6db-d3b7-46a6-83d4-3a012bc89462', '4dc54450-8356-4546-83f7-0491edaa3f2c'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:54 devstack sudo[88054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:54 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:54 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585.b2586d01-cca4-419d-92ac-76422ccb0c97" returned: 0 in 0.447s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-quobyte-b2586d01-cca4-419d-92ac-76422ccb0c97" released by "_delete_snapshot" :: held 2.016s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-quobyte-acf9b96b-a2a7-460a-b52d-9b7c0868c585" released by "delete_snapshot" :: held 2.031s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Created reservations ['d832c271-6330-4e48-afb1-d16d39241a6a', 'db1af307-687a-4621-9479-9ac184600a1f', '6d626928-427f-443a-b99c-b07cf7e7daa1', '0d16d9b3-606d-4e7f-87ab-e78160db7fa5'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Delete snapshot completed successfully.
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c3ea2bd-80f2-4430-99f3-a841142e52a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-b2586d01-cca4-419d-92ac-76422ccb0c97-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:54 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.455s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Deleted volume successfully.
Apr 22 02:40:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6310cd15-7c54-496a-af51-b12c92011af2 tempest-VolumesGetTest-1780801094 None] Lock "cinder-687367f6-62d7-4d03-93d7-9beab4e95410-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-ca1f5490-4621-44db-8907-bee2d930ffe2-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Lock "cinder-ca1f5490-4621-44db-8907-bee2d930ffe2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Acquiring lock "cinder-quobyte-ca1f5490-4621-44db-8907-bee2d930ffe2" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-ca1f5490-4621-44db-8907-bee2d930ffe2" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fd5331-e432-4e53-9a42-d67807b8bfe6]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:55 devstack sudo[88058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2
Apr 22 02:40:55 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "cinder-acf9b96b-a2a7-460a-b52d-9b7c0868c585-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-acf9b96b-a2a7-460a-b52d-9b7c0868c585-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "cinder-quobyte-acf9b96b-a2a7-460a-b52d-9b7c0868c585" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-quobyte-acf9b96b-a2a7-460a-b52d-9b7c0868c585" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f125ea-82ce-4370-898d-e88074cdfd12]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:40:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:55 devstack sudo[88063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585
Apr 22 02:40:55 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:56 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2" returned: 0 in 0.629s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:56 devstack sudo[88067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2
Apr 22 02:40:56 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:56 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585" returned: 0 in 0.542s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:56 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585
Apr 22 02:40:56 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:56 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2" returned: 1 in 0.541s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:56 devstack sudo[88078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2
Apr 22 02:40:56 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:56 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-acf9b96b-a2a7-460a-b52d-9b7c0868c585" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-quobyte-acf9b96b-a2a7-460a-b52d-9b7c0868c585" released by "delete_volume" :: held 1.066s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:UPDATE=194,cinder:SELECT=157,cinder:INSERT=70,cinder:DELETE=17 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Created reservations ['80bbd59e-402a-4ca7-9837-31f5be2f48ea', '17ddad38-2284-4bdf-ae6d-cee69c498b7a', '4c5b5c66-bd2e-433d-b921-6b90ab6d5e38', '3e500d84-50e5-471c-9a54-1737ca9f0ab9'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:56 devstack sudo[88081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:56 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:56 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d0ba66b9-4a27-4e4c-a2ff-702d1dfef23d tempest-GroupsTest-1143847496 None] Group tempest-Group1-1699258425: creating
Apr 22 02:40:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d0ba66b9-4a27-4e4c-a2ff-702d1dfef23d tempest-GroupsTest-1143847496 None] Group tempest-Group1-1699258425: created successfully
Apr 22 02:40:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d0ba66b9-4a27-4e4c-a2ff-702d1dfef23d tempest-GroupsTest-1143847496 None] Create group completed successfully.
Apr 22 02:40:57 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ca1f5490-4621-44db-8907-bee2d930ffe2" returned: 0 in 0.513s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Lock "cinder-quobyte-ca1f5490-4621-44db-8907-bee2d930ffe2" released by "delete_volume" :: held 1.730s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Created reservations ['98c9f751-b239-4bad-818f-932c7da001f1', 'd6c7630f-818c-478b-bdd2-7b2f90d3bf27', '455bd662-3c3a-42cc-b74a-cafe4a49b030', 'f24f30b1-e464-4a09-86d1-976a07e978d2'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:57 devstack sudo[88084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:40:57 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:57 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Deleted volume successfully.
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2acf4218-c9cd-4698-a3c2-63d9b324db94 tempest-VolumeSnapshotQuotasNegativeTestJSON-373056620 None] Lock "cinder-acf9b96b-a2a7-460a-b52d-9b7c0868c585-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:57 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.454s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:40:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Deleted volume successfully.
Apr 22 02:40:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d569044b-bc27-40a7-ac6b-531a093059dd tempest-VolumesGetTest-1780801094 None] Lock "cinder-ca1f5490-4621-44db-8907-bee2d930ffe2-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:40:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-546a3be5-ca92-49cf-b39a-55abf7ee9dea tempest-GroupsTest-1143847496 None] Group tempest-Group2-546966917: creating
Apr 22 02:40:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-546a3be5-ca92-49cf-b39a-55abf7ee9dea tempest-GroupsTest-1143847496 None] Group tempest-Group2-546966917: created successfully
Apr 22 02:40:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-546a3be5-ca92-49cf-b39a-55abf7ee9dea tempest-GroupsTest-1143847496 None] Create group completed successfully.
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Flow 'volume_create_manager' (3694721d-1b30-4311-90e4-deed46fd597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4bfb72-fbd2-4cb7-97c9-07ff57dab10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4bfb72-fbd2-4cb7-97c9-07ff57dab10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-407384901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=23608ec2-037d-43fa-9dac-defd6cb5b7ec,host='devstack@QuobyteHD#QuobyteHD',id=e5ce7271-b6b1-4265-9dce-0d980456b988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caad2968de94e80840c50692bbcf2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:00Z,use_quota=True,user_id='f99855ca2efd414da5ad1ebedb3e99c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8140db5-9a49-409e-9b08-c6ed59c1f3b9),volume_type_id=f8140db5-9a49-409e-9b08-c6ed59c1f3b9)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f27d87-00bc-48de-8d45-c06e851ae6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f27d87-00bc-48de-8d45-c06e851ae6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2363eb-5fd0-4943-9801-682912cd1612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2363eb-5fd0-4943-9801-682912cd1612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ce7271-b6b1-4265-9dce-0d980456b988', 'volume_name': 'volume-e5ce7271-b6b1-4265-9dce-0d980456b988', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b3752b-4d3a-421e-9d48-9889df918e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b3752b-4d3a-421e-9d48-9889df918e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e5b57b-67ec-4a4d-8dd0-e17a29ebd382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Volume e5ce7271-b6b1-4265-9dce-0d980456b988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ce7271-b6b1-4265-9dce-0d980456b988', 'volume_size': 1}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=23608ec2-037d-43fa-9dac-defd6cb5b7ec,created_at=2026-04-22T00:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-407384901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=23608ec2-037d-43fa-9dac-defd6cb5b7ec,host='devstack@QuobyteHD#QuobyteHD',id=e5ce7271-b6b1-4265-9dce-0d980456b988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caad2968de94e80840c50692bbcf2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:00Z,use_quota=True,user_id='f99855ca2efd414da5ad1ebedb3e99c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8140db5-9a49-409e-9b08-c6ed59c1f3b9),volume_type_id=f8140db5-9a49-409e-9b08-c6ed59c1f3b9)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Creating volume e5ce7271-b6b1-4265-9dce-0d980456b988 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:40:59 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:40:59 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988 1073741824
Apr 22 02:40:59 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Flow 'volume_create_manager' (4049dee9-0316-4d5f-8285-d9cc0c774f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feabf3c3-8aea-4718-9480-9709ef3b8bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feabf3c3-8aea-4718-9480-9709ef3b8bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-382221749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d810897-289b-4cc3-a6ae-7a9e871df235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8c4ebec6a4478fae5da93e205fa321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:00Z,use_quota=True,user_id='90bbd5b4cb8e46f1b2d0910f19079f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6e9f8a-dd89-4752-8510-1961bbba5570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6e9f8a-dd89-4752-8510-1961bbba5570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d122fe-a51e-4254-b0d9-5c0ea7386c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d122fe-a51e-4254-b0d9-5c0ea7386c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d810897-289b-4cc3-a6ae-7a9e871df235', 'volume_name': 'volume-3d810897-289b-4cc3-a6ae-7a9e871df235', 'volume_size': 2}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4dab1-d89a-468e-a2a7-f693f5e76de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c4dab1-d89a-468e-a2a7-f693f5e76de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b009ed-f9f4-4cf6-99bd-8ea0ea24ea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:40:59 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Volume 3d810897-289b-4cc3-a6ae-7a9e871df235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d810897-289b-4cc3-a6ae-7a9e871df235', 'volume_size': 2}
Apr 22 02:40:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:00 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988 1073741824" returned: 0 in 0.532s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:00 devstack sudo[88094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988
Apr 22 02:41:00 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:00 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988" returned: 0 in 0.516s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.008s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-382221749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d810897-289b-4cc3-a6ae-7a9e871df235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8c4ebec6a4478fae5da93e205fa321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:00Z,use_quota=True,user_id='90bbd5b4cb8e46f1b2d0910f19079f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Creating volume 3d810897-289b-4cc3-a6ae-7a9e871df235 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:00 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235 2147483648 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:00 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235 2147483648
Apr 22 02:41:00 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e5b57b-67ec-4a4d-8dd0-e17a29ebd382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ce7271-b6b1-4265-9dce-0d980456b988', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1b5bc6-ef1d-4242-a5f9-f4ade4e8cb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:00 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Volume volume-e5ce7271-b6b1-4265-9dce-0d980456b988 (e5ce7271-b6b1-4265-9dce-0d980456b988): created successfully
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1b5bc6-ef1d-4242-a5f9-f4ade4e8cb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Flow 'volume_create_manager' (3694721d-1b30-4311-90e4-deed46fd597e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:00 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e7618210-c009-48ca-93dc-9e6def178a8f tempest-GroupsTest-1143847496 None] Created volume successfully.
Apr 22 02:41:01 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235 2147483648" returned: 0 in 0.687s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:01 devstack sudo[88103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235
Apr 22 02:41:01 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:02 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235" returned: 0 in 0.576s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b009ed-f9f4-4cf6-99bd-8ea0ea24ea32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d810897-289b-4cc3-a6ae-7a9e871df235', 'volume_size': 2}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9608a553-2d8f-405f-99a3-2737da4feb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:02 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Volume volume-3d810897-289b-4cc3-a6ae-7a9e871df235 (3d810897-289b-4cc3-a6ae-7a9e871df235): created successfully
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9608a553-2d8f-405f-99a3-2737da4feb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Flow 'volume_create_manager' (4049dee9-0316-4d5f-8285-d9cc0c774f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:02 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8a6af1c6-a25a-4f6e-a24d-a532b58507ae tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Created volume successfully.
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Acquiring lock "cinder-quobyte-e5ce7271-b6b1-4265-9dce-0d980456b988" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Lock "cinder-quobyte-e5ce7271-b6b1-4265-9dce-0d980456b988" acquired by "delete_volume" :: waited 0.020s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[269fa18f-1b27-44b5-8910-51e4b43cf0ab]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:02 devstack sudo[88120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988
Apr 22 02:41:02 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:02 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988" returned: 0 in 0.586s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:02 devstack sudo[88127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988
Apr 22 02:41:02 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Creating offline snapshot 4d1f53d9-95d6-4629-a2f4-e1216b13ae1e of volume 3d810897-289b-4cc3-a6ae-7a9e871df235 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ba899b-2ec4-48d4-ab91-d8c294b9378b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:02 devstack sudo[88129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235
Apr 22 02:41:02 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:03 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e5ce7271-b6b1-4265-9dce-0d980456b988" returned: 0 in 0.499s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Lock "cinder-quobyte-e5ce7271-b6b1-4265-9dce-0d980456b988" released by "delete_volume" :: held 1.121s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Created reservations ['471da4b4-edce-4534-a663-30f349b6fe27'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:03 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235" returned: 0 in 0.536s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e 2G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:03 devstack cinder-volume[82678]: WARNING cinder.quota [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2115927690 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2115927690, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:41:03 devstack cinder-volume[82678]: WARNING cinder.quota [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2115927690 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2115927690, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:41:03 devstack sudo[88135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e 2G
Apr 22 02:41:03 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Created reservations ['8ca3c033-79a9-4830-9b7a-2b4d58f31e41', 'e8fa25d0-5279-4240-8111-55f6b4e23312', 'ddc061ed-67f2-43e8-9038-1c325c22e6cd', 'c34c8201-511f-4060-92b3-baf20f1a0e8f'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:03 devstack sudo[88137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:03 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:03 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e 2G" returned: 0 in 0.595s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d810897-289b-4cc3-a6ae-7a9e871df235 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:04 devstack sudo[88143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d810897-289b-4cc3-a6ae-7a9e871df235 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e
Apr 22 02:41:04 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:04 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:04 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c835c51e-94a0-4c49-baa4-25edef3b0d7d tempest-GroupsTest-1143847496 None] Delete group completed successfully.
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Created reservations ['fcb9528b-0e1c-4a80-8fd7-bd93f90d1c8f'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:04 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d810897-289b-4cc3-a6ae-7a9e871df235 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e" returned: 0 in 0.478s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:04 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e is being set with open permissions: ugo+rw
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:04 devstack sudo[88148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:04 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:04 devstack sudo[88149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e
Apr 22 02:41:04 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:04 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.469s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:04 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-73be0167-1496-4daa-a448-b5323eac5047 tempest-GroupsTest-1143847496 None] Delete group completed successfully.
Apr 22 02:41:04 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e" returned: 0 in 0.517s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:05 devstack sudo[88157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.info
Apr 22 02:41:05 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:05 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.info" returned: 0 in 0.495s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:05 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.info is being set with open permissions: ugo+rw
Apr 22 02:41:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:05 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.info
Apr 22 02:41:05 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:05 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e4fced8c-9a3b-4f98-91a6-8f6066b5a7e3 tempest-GroupsTest-1143847496 None] Group tempest-GroupsTest-Group-2147007169: creating
Apr 22 02:41:05 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e4fced8c-9a3b-4f98-91a6-8f6066b5a7e3 tempest-GroupsTest-1143847496 None] Group tempest-GroupsTest-Group-2147007169: created successfully
Apr 22 02:41:05 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e4fced8c-9a3b-4f98-91a6-8f6066b5a7e3 tempest-GroupsTest-1143847496 None] Create group completed successfully.
Apr 22 02:41:05 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.info" returned: 0 in 0.478s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.165s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:06 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ddc8b38a-f2ec-49f0-9191-b372811ed706 tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Create snapshot completed successfully
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "cinder-4d1f53d9-95d6-4629-a2f4-e1216b13ae1e-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-4d1f53d9-95d6-4629-a2f4-e1216b13ae1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "cinder-quobyte-3d810897-289b-4cc3-a6ae-7a9e871df235" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-quobyte-3d810897-289b-4cc3-a6ae-7a9e871df235" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "cinder-quobyte-4d1f53d9-95d6-4629-a2f4-e1216b13ae1e" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-quobyte-4d1f53d9-95d6-4629-a2f4-e1216b13ae1e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Deleting offline snapshot 4d1f53d9-95d6-4629-a2f4-e1216b13ae1e of volume 3d810897-289b-4cc3-a6ae-7a9e871df235 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] snapshot_file for this snap is: volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4df0e8-5911-4a1c-a802-8cbc7239b792]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:07 devstack sudo[88190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e
Apr 22 02:41:07 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Flow 'volume_create_manager' (7c7ed7ff-f2fc-4825-b531-37d96ff46319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485c68d8-37ad-4969-a111-cccfd013cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (485c68d8-37ad-4969-a111-cccfd013cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245023032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3b46d336-e4f2-4087-a033-92ec6980baa1,host='devstack@QuobyteHD#QuobyteHD',id=7262a2a3-2475-461b-87d6-8c44ef0da510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caad2968de94e80840c50692bbcf2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:07Z,use_quota=True,user_id='f99855ca2efd414da5ad1ebedb3e99c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b9339b6-c646-452e-b686-1d76079c0b4c),volume_type_id=1b9339b6-c646-452e-b686-1d76079c0b4c)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f054f07-96d9-4d0b-994b-91e482167b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f054f07-96d9-4d0b-994b-91e482167b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437d8dca-0696-4d30-97b3-7015d8dae480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437d8dca-0696-4d30-97b3-7015d8dae480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7262a2a3-2475-461b-87d6-8c44ef0da510', 'volume_name': 'volume-7262a2a3-2475-461b-87d6-8c44ef0da510', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e44af6-3c1f-4f95-8b22-3a35e3ee2613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e44af6-3c1f-4f95-8b22-3a35e3ee2613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dd7046-6f6c-498e-935b-25766c40b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:07 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Volume 7262a2a3-2475-461b-87d6-8c44ef0da510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7262a2a3-2475-461b-87d6-8c44ef0da510', 'volume_size': 1}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3b46d336-e4f2-4087-a033-92ec6980baa1,created_at=2026-04-22T00:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1245023032',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3b46d336-e4f2-4087-a033-92ec6980baa1,host='devstack@QuobyteHD#QuobyteHD',id=7262a2a3-2475-461b-87d6-8c44ef0da510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caad2968de94e80840c50692bbcf2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:07Z,use_quota=True,user_id='f99855ca2efd414da5ad1ebedb3e99c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b9339b6-c646-452e-b686-1d76079c0b4c),volume_type_id=1b9339b6-c646-452e-b686-1d76079c0b4c)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Creating volume 7262a2a3-2475-461b-87d6-8c44ef0da510 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:07 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:07 devstack sudo[88193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510 1073741824
Apr 22 02:41:07 devstack sudo[88193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:07 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e" returned: 0 in 0.878s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d810897-289b-4cc3-a6ae-7a9e871df235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:41:08 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[031c1473-5863-4c36-8735-5681c56dcc16]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:08 devstack sudo[88198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235
Apr 22 02:41:08 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:08 devstack sudo[88193]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510 1073741824" returned: 0 in 0.720s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:08 devstack sudo[88203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510
Apr 22 02:41:08 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:08 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235" returned: 0 in 0.531s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:08 devstack sudo[88208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e
Apr 22 02:41:08 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-17fc0a16-0416-4989-a826-8d3dd7938019 tempest-VolumesActionsTest-160873546 None] Acquiring lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" by "attach_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-17fc0a16-0416-4989-a826-8d3dd7938019 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" acquired by "attach_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:09 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510" returned: 0 in 0.749s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:09 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-17fc0a16-0416-4989-a826-8d3dd7938019 tempest-VolumesActionsTest-160873546 None] Attaching volume 8e982a08-8d56-40ef-8e0b-6dc116cb4d83 to instance 17e35232-d7f4-406c-8565-4ecbcc709e84 at mountpoint /dev/vdb on host None.
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23dd7046-6f6c-498e-935b-25766c40b112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7262a2a3-2475-461b-87d6-8c44ef0da510', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3b9d3f-c6b2-478b-9bb4-a88d56ed2a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e" returned: 0 in 0.595s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-17fc0a16-0416-4989-a826-8d3dd7938019 tempest-VolumesActionsTest-160873546 None] Attach volume completed successfully.
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-17fc0a16-0416-4989-a826-8d3dd7938019 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" released by "attach_volume" :: held 0.119s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Volume volume-7262a2a3-2475-461b-87d6-8c44ef0da510 (7262a2a3-2475-461b-87d6-8c44ef0da510): created successfully
Apr 22 02:41:09 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e
Apr 22 02:41:09 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d3b9d3f-c6b2-478b-9bb4-a88d56ed2a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Flow 'volume_create_manager' (7c7ed7ff-f2fc-4825-b531-37d96ff46319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4b545d5e-58e6-497b-9d1e-3afb76e67d61 tempest-GroupsTest-1143847496 None] Created volume successfully.
Apr 22 02:41:09 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235.4d1f53d9-95d6-4629-a2f4-e1216b13ae1e" returned: 0 in 0.442s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-quobyte-4d1f53d9-95d6-4629-a2f4-e1216b13ae1e" released by "_delete_snapshot" :: held 2.518s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-quobyte-3d810897-289b-4cc3-a6ae-7a9e871df235" released by "delete_snapshot" :: held 2.538s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Created reservations ['a47f606a-4a2b-4ba9-9316-8681bedb1d25', '4069ba36-09fc-4083-a975-14e2ee8bec4a', 'b46dacb7-576c-4105-bf05-8b57936cf4ee', '5f2cb25c-d2b2-4bbe-a74b-b11ef1a5b8dc'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Delete snapshot completed successfully.
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6b9b4edc-1ac8-458e-88b0-d4069eef5aac tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-4d1f53d9-95d6-4629-a2f4-e1216b13ae1e-delete_snapshot" released by "delete_snapshot" :: held 2.720s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-186b2257-3252-4ad8-8bde-2f31fd833767 tempest-VolumesActionsTest-160873546 None] Acquiring lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-detach_volume" by "detach_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-186b2257-3252-4ad8-8bde-2f31fd833767 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-186b2257-3252-4ad8-8bde-2f31fd833767 tempest-VolumesActionsTest-160873546 None] Detaching volume 8e982a08-8d56-40ef-8e0b-6dc116cb4d83 from instance 17e35232-d7f4-406c-8565-4ecbcc709e84.
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-186b2257-3252-4ad8-8bde-2f31fd833767 tempest-VolumesActionsTest-160873546 None] Detach volume completed successfully.
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-186b2257-3252-4ad8-8bde-2f31fd833767 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Flow 'volume_create_manager' (7ff1fec3-1878-4b6b-8af7-87043cc7733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab67b3c7-d800-4ad8-ae5d-e22a6d0796a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab67b3c7-d800-4ad8-ae5d-e22a6d0796a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2000960533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3b46d336-e4f2-4087-a033-92ec6980baa1,host='devstack@QuobyteHD#QuobyteHD',id=6b625a4e-14ab-4cf7-979e-672505ef9314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caad2968de94e80840c50692bbcf2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:10Z,use_quota=True,user_id='f99855ca2efd414da5ad1ebedb3e99c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b9339b6-c646-452e-b686-1d76079c0b4c),volume_type_id=1b9339b6-c646-452e-b686-1d76079c0b4c)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53be5b88-a277-4c91-ad60-e4c5f146a3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53be5b88-a277-4c91-ad60-e4c5f146a3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c673b8b-3d39-4dbc-bfc9-6f27a70f9966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c673b8b-3d39-4dbc-bfc9-6f27a70f9966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b625a4e-14ab-4cf7-979e-672505ef9314', 'volume_name': 'volume-6b625a4e-14ab-4cf7-979e-672505ef9314', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b5171f-8e8d-44ba-932a-bf66eb6a718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b5171f-8e8d-44ba-932a-bf66eb6a718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572195b2-3a86-4df7-af42-a1315f8b3115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Volume 6b625a4e-14ab-4cf7-979e-672505ef9314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b625a4e-14ab-4cf7-979e-672505ef9314', 'volume_size': 1}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3b46d336-e4f2-4087-a033-92ec6980baa1,created_at=2026-04-22T00:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2000960533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3b46d336-e4f2-4087-a033-92ec6980baa1,host='devstack@QuobyteHD#QuobyteHD',id=6b625a4e-14ab-4cf7-979e-672505ef9314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caad2968de94e80840c50692bbcf2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:10Z,use_quota=True,user_id='f99855ca2efd414da5ad1ebedb3e99c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b9339b6-c646-452e-b686-1d76079c0b4c),volume_type_id=1b9339b6-c646-452e-b686-1d76079c0b4c)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Creating volume 6b625a4e-14ab-4cf7-979e-672505ef9314 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:09 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:09 devstack sudo[88217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314 1073741824
Apr 22 02:41:09 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "cinder-3d810897-289b-4cc3-a6ae-7a9e871df235-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-3d810897-289b-4cc3-a6ae-7a9e871df235-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "cinder-quobyte-3d810897-289b-4cc3-a6ae-7a9e871df235" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-quobyte-3d810897-289b-4cc3-a6ae-7a9e871df235" acquired by "delete_volume" :: waited 0.024s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:10 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e747e7-e787-4ce5-8491-7983cf1b9f26]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:10 devstack sudo[88222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235
Apr 22 02:41:10 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:10 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314 1073741824" returned: 0 in 0.622s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:10 devstack sudo[88225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314
Apr 22 02:41:10 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:11 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235" returned: 0 in 0.670s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:11 devstack sudo[88231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235
Apr 22 02:41:11 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:11 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314" returned: 0 in 0.486s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (572195b2-3a86-4df7-af42-a1315f8b3115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b625a4e-14ab-4cf7-979e-672505ef9314', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350200b0-dbe0-46e4-af63-84d579048cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:11 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Volume volume-6b625a4e-14ab-4cf7-979e-672505ef9314 (6b625a4e-14ab-4cf7-979e-672505ef9314): created successfully
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350200b0-dbe0-46e4-af63-84d579048cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Flow 'volume_create_manager' (7ff1fec3-1878-4b6b-8af7-87043cc7733f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:11 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-928d12bc-6e35-4c9f-8485-dddb39a8eaa7 tempest-GroupsTest-1143847496 None] Created volume successfully.
Apr 22 02:41:11 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3d810897-289b-4cc3-a6ae-7a9e871df235" returned: 0 in 0.486s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-quobyte-3d810897-289b-4cc3-a6ae-7a9e871df235" released by "delete_volume" :: held 1.208s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Created reservations ['6109bf85-5792-4610-8cd7-1c9539f79308', 'fb285d76-acd2-41da-a7ff-e5f1ae9027fd', '36754fd9-fa4f-4f02-8f13-5cc4f5e88fdd', 'ac196aff-aa7c-4f02-af86-ac22c3f7f19e'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:11 devstack sudo[88244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:11 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:12 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.572s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:12 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:12 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Deleted volume successfully.
Apr 22 02:41:12 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-34f59727-8c65-4bbe-8bb3-0c9de0a70524 tempest-GroupsTest-1143847496 None] Update group completed successfully.
Apr 22 02:41:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2ee7894e-1593-4968-a06d-0de9ea4fdcce tempest-VolumesSnapshotNegativeTestJSON-1295915857 None] Lock "cinder-3d810897-289b-4cc3-a6ae-7a9e871df235-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:13 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4d7f8bf1-525f-4dd3-98de-f60da016f109 tempest-GroupsTest-1143847496 None] Update group completed successfully.
Apr 22 02:41:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Acquiring lock "cinder-quobyte-6b625a4e-14ab-4cf7-979e-672505ef9314" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Lock "cinder-quobyte-6b625a4e-14ab-4cf7-979e-672505ef9314" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:14 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5af16-6cc4-48b1-a32e-68214ddf7605]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:14 devstack sudo[88275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314
Apr 22 02:41:14 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:15 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314" returned: 0 in 0.690s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:15 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314
Apr 22 02:41:15 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:16 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b625a4e-14ab-4cf7-979e-672505ef9314" returned: 0 in 0.591s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Lock "cinder-quobyte-6b625a4e-14ab-4cf7-979e-672505ef9314" released by "delete_volume" :: held 1.314s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Acquiring lock "cinder-quobyte-7262a2a3-2475-461b-87d6-8c44ef0da510" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Lock "cinder-quobyte-7262a2a3-2475-461b-87d6-8c44ef0da510" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d130e-3855-4cd3-a4d9-9429f659ade9]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:16 devstack sudo[88283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510
Apr 22 02:41:16 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Flow 'volume_create_manager' (d07cc48e-6ee1-4ca5-8446-f0831d262839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f600b9-1b3e-4bd3-8b3a-e8c3632c87ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f600b9-1b3e-4bd3-8b3a-e8c3632c87ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6a23f3-e894-46bb-a97b-f254020e9c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ede0e726d04f5a9d3965640eb828ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:16Z,use_quota=True,user_id='08b3e5615ebd459a9bd4a85f46bc1782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd76d83f-a840-4c74-8b91-efefec4f9900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd76d83f-a840-4c74-8b91-efefec4f9900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e331df-cb75-45a2-bc61-a717285ea134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47e331df-cb75-45a2-bc61-a717285ea134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d6a23f3-e894-46bb-a97b-f254020e9c50', 'volume_name': 'volume-0d6a23f3-e894-46bb-a97b-f254020e9c50', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d17356-0547-48f2-b5d0-6d88032e4329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d17356-0547-48f2-b5d0-6d88032e4329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb64aad5-293e-4dc1-bbed-0b7fa3d96cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:16 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Volume 0d6a23f3-e894-46bb-a97b-f254020e9c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d6a23f3-e894-46bb-a97b-f254020e9c50', 'volume_size': 1}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d6a23f3-e894-46bb-a97b-f254020e9c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ede0e726d04f5a9d3965640eb828ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:16Z,use_quota=True,user_id='08b3e5615ebd459a9bd4a85f46bc1782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Creating volume 0d6a23f3-e894-46bb-a97b-f254020e9c50 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:16 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:16 devstack sudo[88285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50 1073741824
Apr 22 02:41:16 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:16 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510" returned: 0 in 0.620s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:16 devstack sudo[88290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510
Apr 22 02:41:16 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:17 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50 1073741824" returned: 0 in 0.551s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:17 devstack sudo[88295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50
Apr 22 02:41:17 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:17 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7262a2a3-2475-461b-87d6-8c44ef0da510" returned: 0 in 0.578s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Lock "cinder-quobyte-7262a2a3-2475-461b-87d6-8c44ef0da510" released by "delete_volume" :: held 1.225s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Created reservations ['9ee16be9-26fd-42d0-8ace-1241c69fabaa'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:17 devstack cinder-volume[82678]: WARNING cinder.quota [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-425952447 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-425952447, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:41:17 devstack cinder-volume[82678]: WARNING cinder.quota [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-425952447 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-425952447, it is now deprecated. Please use the default quota class for default quota.
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Created reservations ['ac75722f-eb1e-4559-9d8d-a7711002faf3', 'd86b869d-0043-429e-8b4a-cc6b4acf15a8', '1d67233d-e075-425e-8260-955859335ad5', '51be0415-4d4b-41af-ad5e-63966104b046'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Created reservations ['8f48e5c0-d804-4b73-a16c-2cc2d19b7931', 'f2f1bc36-3b98-45d6-a946-909174ca04a0', '2aae2a18-fb3d-470c-a9f7-bb326bbfdb93', '7049e065-4764-4840-a6f0-4126f35efe63'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:17 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:17 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:17 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50" returned: 0 in 0.551s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb64aad5-293e-4dc1-bbed-0b7fa3d96cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d6a23f3-e894-46bb-a97b-f254020e9c50', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992a4274-13ba-4df6-b0ab-ddcf06fa7c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:17 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Volume volume-0d6a23f3-e894-46bb-a97b-f254020e9c50 (0d6a23f3-e894-46bb-a97b-f254020e9c50): created successfully
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992a4274-13ba-4df6-b0ab-ddcf06fa7c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Flow 'volume_create_manager' (d07cc48e-6ee1-4ca5-8446-f0831d262839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:17 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-608cb4b4-e63e-4ea0-a31a-16e01ff6faa0 tempest-CinderUnicodeTest-1934781945 None] Created volume successfully.
Apr 22 02:41:18 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.549s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:18 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:18 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8e66f791-9b5d-4619-bfb6-81c343375471 tempest-GroupsTest-1143847496 None] Delete group completed successfully.
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb355ee7-7d00-449a-ae75-705df3ebffb2]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Flow 'volume_create_manager' (5e887d0c-fdb7-4037-add5-9befbcd682e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08296e3-91ed-4a03-b629-f6ee262bec74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:19 devstack sudo[88336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:41:19 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08296e3-91ed-4a03-b629-f6ee262bec74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-303416972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b283d92-a6b1-464e-9d2e-cbbbeb689748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ede0e726d04f5a9d3965640eb828ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:19Z,use_quota=True,user_id='08b3e5615ebd459a9bd4a85f46bc1782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8726d62-bb20-4818-b1b7-92559c308352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8726d62-bb20-4818-b1b7-92559c308352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c764a2-6ffe-4f65-9e11-b91ab24b3c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c764a2-6ffe-4f65-9e11-b91ab24b3c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b283d92-a6b1-464e-9d2e-cbbbeb689748', 'volume_name': 'volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccdb42c-e495-4d4f-bca7-987c1f76f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ccdb42c-e495-4d4f-bca7-987c1f76f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c459f07f-844c-4052-b80a-349767f5d401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:19 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Volume 6b283d92-a6b1-464e-9d2e-cbbbeb689748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748', 'volume_size': 1}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:19 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.571s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34c0048-18ee-472c-befe-98892396d977]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:19 devstack sudo[88341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:41:19 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:20 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.604s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.802d791f-ce70-4638-a8c5-139892ef0e9e8tauew0c.img {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:20 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.802d791f-ce70-4638-a8c5-139892ef0e9e8tauew0c.img
Apr 22 02:41:20 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:22 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.802d791f-ce70-4638-a8c5-139892ef0e9e8tauew0c.img" returned: 0 in 2.723s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3612a3-67f1-4c88-8002-1153f8cbeff2]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:23 devstack sudo[88361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:41:23 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:23 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.787s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:23 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83, size 1024.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.802d791f-ce70-4638-a8c5-139892ef0e9e8tauew0c.img {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:41:23 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Converted 1024.00 MB image at 375.93 MB/s
Apr 22 02:41:23 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] 802d791f-ce70-4638-a8c5-139892ef0e9e was raw, no need to convert to raw {{(pid=82678) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:UPDATE=202,cinder:SELECT=183,cinder:INSERT=46,cinder:DELETE=18 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Flow 'volume_create_manager' (8782439a-f830-43d6-9d75-efaebb62a7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64a0de3-b0ba-416b-9a81-298560a31133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64a0de3-b0ba-416b-9a81-298560a31133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1878914765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d4aca318224ff0a54b6f2d0f8479b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:29Z,use_quota=True,user_id='0db70e5676174279a6e3b50eb7d6d7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779b9d25-ee82-4a78-9822-76eb10ee45df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779b9d25-ee82-4a78-9822-76eb10ee45df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f4bff5-a02d-4cf4-a2b6-b418e4cb9cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f4bff5-a02d-4cf4-a2b6-b418e4cb9cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f', 'volume_name': 'volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1206ca79-9dc6-47a8-9bdc-f0adbdbd7f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1206ca79-9dc6-47a8-9bdc-f0adbdbd7f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ca0a82-fe6e-43da-ac37-9bdb0c93046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:28 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Volume 7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f', 'volume_size': 1}
Apr 22 02:41:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:31 devstack sudo[88370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:31 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:31 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.503s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.660s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Uploaded volume to glance image-id: 802d791f-ce70-4638-a8c5-139892ef0e9e. {{(pid=82678) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.502s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-303416972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b283d92-a6b1-464e-9d2e-cbbbeb689748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ede0e726d04f5a9d3965640eb828ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:19Z,use_quota=True,user_id='08b3e5615ebd459a9bd4a85f46bc1782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Creating volume 6b283d92-a6b1-464e-9d2e-cbbbeb689748 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:34 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:34 devstack sudo[88391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 1073741824
Apr 22 02:41:34 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:34 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4df87df6-6cb9-4fda-9aa4-fdb7ee235de8 tempest-VolumesActionsTest-160873546 None] Copy volume to image completed successfully.
Apr 22 02:41:35 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 1073741824" returned: 0 in 0.514s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:35 devstack sudo[88399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748
Apr 22 02:41:35 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:35 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.115s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1878914765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41d4aca318224ff0a54b6f2d0f8479b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:29Z,use_quota=True,user_id='0db70e5676174279a6e3b50eb7d6d7d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Creating volume 7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:35 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c459f07f-844c-4052-b80a-349767f5d401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:35 devstack sudo[88402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f 1073741824
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cb42c3-598b-45f9-bf22-5db2115ec225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:35 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:35 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Volume volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 (6b283d92-a6b1-464e-9d2e-cbbbeb689748): created successfully
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cb42c3-598b-45f9-bf22-5db2115ec225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Flow 'volume_create_manager' (5e887d0c-fdb7-4037-add5-9befbcd682e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-23488852-ced4-4cc7-8ddd-1f577e2a1ade tempest-CinderUnicodeTest-1934781945 None] Created volume successfully.
Apr 22 02:41:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:36 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f 1073741824" returned: 0 in 0.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:36 devstack sudo[88407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f
Apr 22 02:41:36 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:36 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f" returned: 0 in 0.708s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.876s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ca0a82-fe6e-43da-ac37-9bdb0c93046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f59d71-f98b-4dd5-8912-509e1887dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[3194fc66-6005-4a86-a8f0-06b688aed3ec]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:37 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Volume volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f (7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f): created successfully
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f59d71-f98b-4dd5-8912-509e1887dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Flow 'volume_create_manager' (8782439a-f830-43d6-9d75-efaebb62a7e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:37 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e3201f29-6c5d-4795-958a-d8ae6b367831 tempest-VolumesServicesTestJSON-159816422 None] Created volume successfully.
Apr 22 02:41:37 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:41:37 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:37 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.530s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc129c1-6e01-428d-8746-6d7732cfa1a9]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:37 devstack sudo[88443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:41:37 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:38 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.675s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:38 devstack sudo[88455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img
Apr 22 02:41:38 devstack sudo[88455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Acquiring lock "cinder-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Lock "cinder-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Acquiring lock "cinder-quobyte-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Lock "cinder-quobyte-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:38 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fedf31-4085-464e-a457-00873d27c660]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:38 devstack sudo[88457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f
Apr 22 02:41:38 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:39 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f" returned: 0 in 1.061s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:39 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f
Apr 22 02:41:39 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:40 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f" returned: 0 in 1.075s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Lock "cinder-quobyte-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f" released by "delete_volume" :: held 2.172s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Created reservations ['6560ed85-423b-4770-9989-dbd9697e040a', '1a2037af-0abd-4468-af5a-a25dbf89afe5', '3525c47a-e2ff-4fa1-91ea-ea9f41c50794', '7445b5c4-12fc-438d-8b7c-1e43b760c5b2'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:40 devstack sudo[88478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:40 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:41 devstack sudo[88455]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img" returned: 0 in 2.815s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0230b9-a223-43e3-ad88-5dacab9f1a44]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (7bb86ee3-88c6-4ea6-bcaf-aacb44753f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfdbe38-4d5e-4fc3-9522-0085182c9afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfdbe38-4d5e-4fc3-9522-0085182c9afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897238957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b95965-99f4-4d02-adf4-a268cc8f1755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:41Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3158deff-d401-4aef-a783-fe827b1679d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3158deff-d401-4aef-a783-fe827b1679d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cd5fa3-4a9b-4c79-829f-025570cd78b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22cd5fa3-4a9b-4c79-829f-025570cd78b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b95965-99f4-4d02-adf4-a268cc8f1755', 'volume_name': 'volume-d0b95965-99f4-4d02-adf4-a268cc8f1755', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba2fbd6-941c-4e1c-81ae-3db745a4d2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba2fbd6-941c-4e1c-81ae-3db745a4d2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0058fe33-1e8a-4889-a05b-394bbac1cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:41 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Volume d0b95965-99f4-4d02-adf4-a268cc8f1755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b95965-99f4-4d02-adf4-a268cc8f1755', 'volume_size': 1}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:41 devstack sudo[88480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:41:41 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:41 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.443s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:41 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Deleted volume successfully.
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa5f759d-e5b8-4a61-8110-a3a3e0eb4817 tempest-VolumesServicesTestJSON-159816422 None] Lock "cinder-7d9776c2-b5f5-4dbf-a886-cb5f0cdb6d5f-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:41 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.631s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83, size 1024.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:41:41 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Converted 1024.00 MB image at 363.04 MB/s
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] e10a1d3e-592c-4521-805d-ad95a7c3b0fc was raw, converting to qcow2 {{(pid=82678) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eda80d3-c935-4713-a186-a5b7865d3c94]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:41 devstack sudo[88487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img
Apr 22 02:41:41 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:42 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img" returned: 0 in 0.498s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:42 devstack sudo[88491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img
Apr 22 02:41:42 devstack sudo[88491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:42 devstack sudo[88491]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img" returned: 1 in 0.506s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:41:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img /opt/stack/data/cinder/conversion/vol_upload_7qvb4tbk {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:42 devstack sudo[88496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img /opt/stack/data/cinder/conversion/vol_upload_7qvb4tbk
Apr 22 02:41:42 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:43 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img /opt/stack/data/cinder/conversion/vol_upload_7qvb4tbk" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:43 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Image conversion details: src /opt/stack/data/cinder/conversion/8e982a08-8d56-40ef-8e0b-6dc116cb4d83.temp_image.e10a1d3e-592c-4521-805d-ad95a7c3b0fcv02gt1sw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7qvb4tbk {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:41:43 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 22 02:41:43 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bd0be2-0f1b-4d22-85dd-dd7f0740b78c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7qvb4tbk {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:43 devstack sudo[88501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7qvb4tbk
Apr 22 02:41:43 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:43 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7qvb4tbk" returned: 0 in 0.557s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.886s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Uploaded volume to glance image-id: e10a1d3e-592c-4521-805d-ad95a7c3b0fc. {{(pid=82678) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 22 02:41:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.243s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Creating offline snapshot 7b7c2e28-8c00-4548-b171-951b163348c6 of volume 6b283d92-a6b1-464e-9d2e-cbbbeb689748 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:41:44 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-eff7c4ec-66a1-49bf-8ae8-bf9d75a50a7c tempest-VolumesActionsTest-160873546 None] Copy volume to image completed successfully.
Apr 22 02:41:44 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[960698f5-fc94-47bb-a025-c77bf9b1c903]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:45 devstack sudo[88506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748
Apr 22 02:41:45 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:45 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748" returned: 0 in 0.527s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:45 devstack sudo[88511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 1G
Apr 22 02:41:45 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:46 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 1G" returned: 0 in 0.539s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:46 devstack sudo[88516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6
Apr 22 02:41:46 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Acquiring lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Acquiring lock "cinder-quobyte-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Lock "cinder-quobyte-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[6411d720-ce3b-4f09-b148-d153557cc5c9]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:46 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:41:46 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:46 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6" returned: 0 in 0.608s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:46 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 is being set with open permissions: ugo+rw
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:46 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6
Apr 22 02:41:46 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:46 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.576s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:46 devstack sudo[88530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83
Apr 22 02:41:46 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:47 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:47 devstack sudo[88534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.info
Apr 22 02:41:47 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:47 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" returned: 0 in 0.464s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Lock "cinder-quobyte-8e982a08-8d56-40ef-8e0b-6dc116cb4d83" released by "delete_volume" :: held 1.064s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Created reservations ['34976cf1-e479-46f7-b78b-341c63949ecd', '7788e5c9-8276-4c7e-b1d0-656f5bea5efe', '2bf57bbd-d5ed-4de7-8c9e-5233de4f9474', '1f50a8ac-4257-4f95-a1b0-1b992d258968'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:47 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:47 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Flow 'volume_create_manager' (c1a18efb-0d57-4b52-b19f-9dd55b6dce83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083db82b-1cb8-40f1-b6d9-d908dd320e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083db82b-1cb8-40f1-b6d9-d908dd320e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1586189476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c47988-65bb-4122-af49-488cea8880e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a87aa16626479e896d1a7351076681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:48Z,use_quota=True,user_id='98e9736edd1c46cf9d4ade8f3f9912c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad90e47a-afab-4f6d-a993-bd4aba337e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad90e47a-afab-4f6d-a993-bd4aba337e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3b9223-f151-4c7a-b4f3-4489d28eb8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.image.glance [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Creating Keystone auth plugin from conf {{(pid=82678) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 22 02:41:47 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.info" returned: 0 in 0.527s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:47 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.info is being set with open permissions: ugo+rw
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:47 devstack sudo[88540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.info
Apr 22 02:41:47 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3b9223-f151-4c7a-b4f3-4489d28eb8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02c47988-65bb-4122-af49-488cea8880e5', 'volume_name': 'volume-02c47988-65bb-4122-af49-488cea8880e5', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6970c5f0a0>}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39191b70-3d9a-4db1-b1ff-d25d593a7466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39191b70-3d9a-4db1-b1ff-d25d593a7466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f91671f-d108-4e74-9fb5-ea5fd4f2f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:47 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Volume 02c47988-65bb-4122-af49-488cea8880e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02c47988-65bb-4122-af49-488cea8880e5', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6970c5f0a0>}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Trying to clone 02c47988-65bb-4122-af49-488cea8880e5 from image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]). {{(pid=82678) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 22 02:41:47 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Deleted volume successfully.
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-fd99282f-892f-452b-9b0f-6eca6f845bb4 tempest-VolumesActionsTest-160873546 None] Lock "cinder-8e982a08-8d56-40ef-8e0b-6dc116cb4d83-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 22 02:41:47 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Image download 20.69 MB at 20.69 MB/s
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5e38e9-fcbe-45e2-82ff-bc81f5f3e729]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:48 devstack sudo[88543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD
Apr 22 02:41:48 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:48 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.info" returned: 0 in 0.455s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.995s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1897238957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b95965-99f4-4d02-adf4-a268cc8f1755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:41Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Creating volume d0b95965-99f4-4d02-adf4-a268cc8f1755 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:48 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:48 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8df9301a-ce88-4c7b-8faf-6615314081cd tempest-CinderUnicodeTest-1934781945 None] Create snapshot completed successfully
Apr 22 02:41:48 devstack sudo[88546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755 1073741824
Apr 22 02:41:48 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:48 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD" returned: 0 in 0.519s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Temporary image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 is fetched for user 98e9736edd1c46cf9d4ade8f3f9912c4. {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[33273e04-5e35-4f20-9055-7555ed01b967]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:48 devstack sudo[88554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD
Apr 22 02:41:48 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:48 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755 1073741824" returned: 0 in 0.553s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:48 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755
Apr 22 02:41:48 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:49 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:49 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0058fe33-1e8a-4889-a05b-394bbac1cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b95965-99f4-4d02-adf4-a268cc8f1755', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf73824-bd9d-42f1-8504-03e4a849c059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "cinder-7b7c2e28-8c00-4548-b171-951b163348c6-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD" returned: 0 in 0.647s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1586189476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c47988-65bb-4122-af49-488cea8880e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a87aa16626479e896d1a7351076681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:48Z,use_quota=True,user_id='98e9736edd1c46cf9d4ade8f3f9912c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Creating volume 02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:49 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:49 devstack sudo[88563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 1073741824
Apr 22 02:41:49 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:49 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Volume volume-d0b95965-99f4-4d02-adf4-a268cc8f1755 (d0b95965-99f4-4d02-adf4-a268cc8f1755): created successfully
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf73824-bd9d-42f1-8504-03e4a849c059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (7bb86ee3-88c6-4ea6-bcaf-aacb44753f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-7b7c2e28-8c00-4548-b171-951b163348c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "cinder-quobyte-6b283d92-a6b1-464e-9d2e-cbbbeb689748" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:49 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3f174dbd-4774-42a1-8e6e-bdd83496ac2c tempest-VolumesActionsTest-1058397490 None] Created volume successfully.
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-quobyte-6b283d92-a6b1-464e-9d2e-cbbbeb689748" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "cinder-quobyte-7b7c2e28-8c00-4548-b171-951b163348c6" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-quobyte-7b7c2e28-8c00-4548-b171-951b163348c6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Deleting offline snapshot 7b7c2e28-8c00-4548-b171-951b163348c6 of volume 6b283d92-a6b1-464e-9d2e-cbbbeb689748 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] snapshot_file for this snap is: volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6d35e3-d05c-44e2-b023-61a1bf7bae8e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:49 devstack sudo[88565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6
Apr 22 02:41:49 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0779b6b5-d436-4a50-bbe4-f4a00ca0555c tempest-VolumesActionsTest-1058397490 None] Acquiring lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755" by "attach_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0779b6b5-d436-4a50-bbe4-f4a00ca0555c tempest-VolumesActionsTest-1058397490 None] Lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755" acquired by "attach_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:49 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0779b6b5-d436-4a50-bbe4-f4a00ca0555c tempest-VolumesActionsTest-1058397490 None] Attaching volume d0b95965-99f4-4d02-adf4-a268cc8f1755 to instance bbea882e-53ac-4f87-913f-122f84eb6509 at mountpoint /dev/vdb on host None.
Apr 22 02:41:49 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0779b6b5-d436-4a50-bbe4-f4a00ca0555c tempest-VolumesActionsTest-1058397490 None] Attach volume completed successfully.
Apr 22 02:41:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0779b6b5-d436-4a50-bbe4-f4a00ca0555c tempest-VolumesActionsTest-1058397490 None] Lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755" released by "attach_volume" :: held 0.118s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:50 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6" returned: 0 in 0.639s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:41:50 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 1073741824" returned: 0 in 0.760s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8954bca-b1f0-4762-8f7d-31902fd0185b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:50 devstack sudo[88574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5
Apr 22 02:41:50 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:50 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748
Apr 22 02:41:50 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:50 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5" returned: 0 in 0.543s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Attempting download of a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}])) to volume 02c47988-65bb-4122-af49-488cea8880e5. {{(pid=82678) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[155040f1-9cf3-4480-a9d1-7d6c083a8655]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qed56yld {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:50 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748" returned: 0 in 0.719s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:50 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6
Apr 22 02:41:50 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:50 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qed56yld
Apr 22 02:41:50 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:50 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d483bb2a-9445-4b57-9860-8a1cb2e1a486 tempest-VolumesActionsTest-1136487812 None] Terminate volume connection completed successfully.
Apr 22 02:41:51 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d483bb2a-9445-4b57-9860-8a1cb2e1a486 tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-detach_volume" by "detach_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qed56yld" returned: 0 in 0.645s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qed56yld {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d483bb2a-9445-4b57-9860-8a1cb2e1a486 tempest-VolumesActionsTest-1136487812 None] Lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:51 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d483bb2a-9445-4b57-9860-8a1cb2e1a486 tempest-VolumesActionsTest-1136487812 None] Detaching volume d0b95965-99f4-4d02-adf4-a268cc8f1755 from instance bbea882e-53ac-4f87-913f-122f84eb6509.
Apr 22 02:41:51 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qed56yld
Apr 22 02:41:51 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:51 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d483bb2a-9445-4b57-9860-8a1cb2e1a486 tempest-VolumesActionsTest-1136487812 None] Detach volume completed successfully.
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d483bb2a-9445-4b57-9860-8a1cb2e1a486 tempest-VolumesActionsTest-1136487812 None] Lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:51 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6" returned: 0 in 0.738s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:51 devstack sudo[88594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6
Apr 22 02:41:51 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:51 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qed56yld" returned: 1 in 0.538s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_qed56yld' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca5b5e4-0123-40bd-8762-a472d1c8a4ab]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:52 devstack sudo[88599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD
Apr 22 02:41:52 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:52 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748.7b7c2e28-8c00-4548-b171-951b163348c6" returned: 0 in 0.549s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b3995b28-f821-4005-baa1-f21390f431aa tempest-VolumesActionsTest-1058397490 None] Acquiring lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-detach_volume" by "detach_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-quobyte-7b7c2e28-8c00-4548-b171-951b163348c6" released by "_delete_snapshot" :: held 2.753s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b3995b28-f821-4005-baa1-f21390f431aa tempest-VolumesActionsTest-1058397490 None] Lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b3995b28-f821-4005-baa1-f21390f431aa tempest-VolumesActionsTest-1058397490 None] Volume detach called, but volume not attached.
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-quobyte-6b283d92-a6b1-464e-9d2e-cbbbeb689748" released by "delete_snapshot" :: held 2.776s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b3995b28-f821-4005-baa1-f21390f431aa tempest-VolumesActionsTest-1058397490 None] Lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Created reservations ['a39efb0e-706a-4ab6-b64f-d6d94071c926', '15dbd1e3-7494-42f1-9a46-cbc11fabb04e', 'd6133ca7-bd2a-4fde-843f-89a060820497', '3ebed9c8-b097-4bc6-a344-77b7c16dbf45'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Delete snapshot completed successfully.
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5cb2b05b-4582-4821-848d-20849589559b tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-7b7c2e28-8c00-4548-b171-951b163348c6-delete_snapshot" released by "delete_snapshot" :: held 2.876s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:52 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD" returned: 0 in 0.640s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 was qcow2, converting to raw {{(pid=82678) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:52 devstack sudo[88606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5
Apr 22 02:41:52 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "cinder-6b283d92-a6b1-464e-9d2e-cbbbeb689748-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Flow 'volume_create_manager' (c3fb5daa-8456-40d2-b883-890af7d98502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b01b9f-6bf1-4eec-87d6-ffb46eda4e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-6b283d92-a6b1-464e-9d2e-cbbbeb689748-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b01b9f-6bf1-4eec-87d6-ffb46eda4e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2033317695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c41de2f-0f16-4088-8c80-bd2a12723849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54fad34cd0439b884c250531d2d202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:53Z,use_quota=True,user_id='08bcde1f64cb417c949dcde98d2d9536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6892120-3dd8-4822-ac9c-264cb5f3eb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6892120-3dd8-4822-ac9c-264cb5f3eb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3b1495-2de8-428c-b5e7-1f8d78c8b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c3b1495-2de8-428c-b5e7-1f8d78c8b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c41de2f-0f16-4088-8c80-bd2a12723849', 'volume_name': 'volume-1c41de2f-0f16-4088-8c80-bd2a12723849', 'volume_size': 2}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a387fc6-dcfa-4e31-bd87-ee34ee46dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a387fc6-dcfa-4e31-bd87-ee34ee46dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def7ea38-e4c7-4481-8562-222ea177f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Volume 1c41de2f-0f16-4088-8c80-bd2a12723849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c41de2f-0f16-4088-8c80-bd2a12723849', 'volume_size': 2}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:41:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2033317695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c41de2f-0f16-4088-8c80-bd2a12723849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec54fad34cd0439b884c250531d2d202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:41:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:41:53Z,use_quota=True,user_id='08bcde1f64cb417c949dcde98d2d9536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Creating volume 1c41de2f-0f16-4088-8c80-bd2a12723849 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:41:52 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849 2147483648 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:52 devstack sudo[88608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849 2147483648
Apr 22 02:41:52 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Acquiring lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "cinder-quobyte-6b283d92-a6b1-464e-9d2e-cbbbeb689748" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-quobyte-6b283d92-a6b1-464e-9d2e-cbbbeb689748" acquired by "delete_volume" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9f0eb4-e707-4f3d-9e47-553651b54bd7]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Acquiring lock "cinder-quobyte-d0b95965-99f4-4d02-adf4-a268cc8f1755" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Lock "cinder-quobyte-d0b95965-99f4-4d02-adf4-a268cc8f1755" acquired by "delete_volume" :: waited 0.023s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa21166f-1074-405e-9887-70328af5a621]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:53 devstack sudo[88610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748
Apr 22 02:41:53 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:53 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755
Apr 22 02:41:53 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:53 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849 2147483648" returned: 0 in 0.743s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:53 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755" returned: 0 in 0.641s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:53 devstack sudo[88629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849
Apr 22 02:41:53 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:53 devstack sudo[88630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755
Apr 22 02:41:53 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:53 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5" returned: 0 in 1.121s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_o9qo8is8devstack@QuobyteHD, size 112.00 MB, duration 1.12 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:41:53 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Converted 112.00 MB image at 99.78 MB/s
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:53 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748" returned: 0 in 0.793s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:53 devstack sudo[88633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 1G
Apr 22 02:41:53 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:53 devstack sudo[88635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748
Apr 22 02:41:53 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:54 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849" returned: 0 in 0.508s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def7ea38-e4c7-4481-8562-222ea177f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c41de2f-0f16-4088-8c80-bd2a12723849', 'volume_size': 2}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ccc81c-3b2f-4553-b431-0d34dffe0093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:54 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Volume volume-1c41de2f-0f16-4088-8c80-bd2a12723849 (1c41de2f-0f16-4088-8c80-bd2a12723849): created successfully
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5ccc81c-3b2f-4553-b431-0d34dffe0093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Flow 'volume_create_manager' (c3fb5daa-8456-40d2-b883-890af7d98502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b21dcc61-5038-4542-a4ce-070559692da0 tempest-VolumesCloneNegativeTest-540913650 None] Created volume successfully.
Apr 22 02:41:54 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 1G" returned: 0 in 0.566s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:54 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d0b95965-99f4-4d02-adf4-a268cc8f1755" returned: 0 in 0.653s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[059d00bc-62ae-4479-a956-08af28e46719]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Lock "cinder-quobyte-d0b95965-99f4-4d02-adf4-a268cc8f1755" released by "delete_volume" :: held 1.325s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Created reservations ['805b8a41-0a3b-4063-b55a-3c67f4d116cc', '71660f44-9894-47e6-aff3-52069971fa80', 'bf9a9a1b-eb36-4099-9e3f-d3e3932c2428', 'aa4f27a7-a8d3-4eb4-89d3-91ecf134506b'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:54 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5
Apr 22 02:41:54 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:54 devstack sudo[88645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:54 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:54 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6b283d92-a6b1-464e-9d2e-cbbbeb689748" returned: 0 in 0.720s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-quobyte-6b283d92-a6b1-464e-9d2e-cbbbeb689748" released by "delete_volume" :: held 1.553s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Created reservations ['98cad7c0-18b5-40fe-88b8-53ed5e49bb90', '277a7f3a-3ae8-425d-8f53-486733f87963', 'ffeb5ea0-18f4-44a7-8874-a1ef910c54df', 'ecdd5649-be42-4bcb-9997-eb8405167671'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:54 devstack sudo[88648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:54 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:54 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5" returned: 0 in 0.515s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:54 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Deleted volume successfully.
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-239b3b00-fe06-417c-b066-7230db20739a tempest-VolumesActionsTest-1058397490 None] Lock "cinder-d0b95965-99f4-4d02-adf4-a268cc8f1755-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:54 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5
Apr 22 02:41:54 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "cinder-0d6a23f3-e894-46bb-a97b-f254020e9c50-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-0d6a23f3-e894-46bb-a97b-f254020e9c50-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "cinder-quobyte-0d6a23f3-e894-46bb-a97b-f254020e9c50" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-quobyte-0d6a23f3-e894-46bb-a97b-f254020e9c50" acquired by "delete_volume" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd2fdb-6816-4bc6-ad18-b806cb7923f2]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:55 devstack sudo[88656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50
Apr 22 02:41:55 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:55 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.610s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:55 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Deleted volume successfully.
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-13836013-8780-48e0-8bc6-24d0e08816f8 tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-6b283d92-a6b1-464e-9d2e-cbbbeb689748-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Acquiring lock "cinder-1c41de2f-0f16-4088-8c80-bd2a12723849-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Lock "cinder-1c41de2f-0f16-4088-8c80-bd2a12723849-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Acquiring lock "cinder-quobyte-1c41de2f-0f16-4088-8c80-bd2a12723849" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Lock "cinder-quobyte-1c41de2f-0f16-4088-8c80-bd2a12723849" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[2027def1-f033-488e-94b8-3d2dc77db76a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:55 devstack sudo[88659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849
Apr 22 02:41:55 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:55 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5" returned: 1 in 0.802s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Downloaded image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}])) to volume 02c47988-65bb-4122-af49-488cea8880e5 successfully. {{(pid=82678) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Temporary image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 for user 98e9736edd1c46cf9d4ade8f3f9912c4 is deleted. {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Marking volume 02c47988-65bb-4122-af49-488cea8880e5 as bootable. {{(pid=82678) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Copying metadata from image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 to 02c47988-65bb-4122-af49-488cea8880e5. {{(pid=82678) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Creating volume glance metadata for volume 02c47988-65bb-4122-af49-488cea8880e5 backed by image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82678) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f91671f-d108-4e74-9fb5-ea5fd4f2f655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c47988-65bb-4122-af49-488cea8880e5', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f6970c5f0a0>}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:55 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21476ec-186f-41fa-bf22-5cfd93c73d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50" returned: 0 in 0.640s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:55 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Volume volume-02c47988-65bb-4122-af49-488cea8880e5 (02c47988-65bb-4122-af49-488cea8880e5): created successfully
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21476ec-186f-41fa-bf22-5cfd93c73d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Flow 'volume_create_manager' (c1a18efb-0d57-4b52-b19f-9dd55b6dce83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:55 devstack sudo[88667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50
Apr 22 02:41:55 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:55 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-475cedf6-cc9e-45fc-a594-218816251e73 tempest-VolumesImageMetadata-1090472648 None] Created volume successfully.
Apr 22 02:41:55 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849" returned: 0 in 0.563s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:55 devstack sudo[88672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849
Apr 22 02:41:55 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:56 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0d6a23f3-e894-46bb-a97b-f254020e9c50" returned: 0 in 0.425s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-quobyte-0d6a23f3-e894-46bb-a97b-f254020e9c50" released by "delete_volume" :: held 1.099s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Created reservations ['a2d9e121-7809-459b-8b1f-73f4f96f17a0', '82375387-6685-4e12-8129-a2128002288c', '588fd1d1-43e2-4ec6-b2e1-01a38edd96cf', '54588bb8-fe07-46e4-96df-b952eeb9a1a7'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:56 devstack sudo[88675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:56 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:56 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1c41de2f-0f16-4088-8c80-bd2a12723849" returned: 0 in 0.554s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Lock "cinder-quobyte-1c41de2f-0f16-4088-8c80-bd2a12723849" released by "delete_volume" :: held 1.143s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Acquiring lock "cinder-02c47988-65bb-4122-af49-488cea8880e5-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Lock "cinder-02c47988-65bb-4122-af49-488cea8880e5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Created reservations ['d465376e-3251-4ea2-858c-287b1758bd10', 'caa4a42f-eb8d-4a2c-b79f-4c172c0a5304', '3c21310e-c9ee-4a6d-a5aa-4b2d29f95a42', '708d3742-3bb6-4998-bf77-daef5d0e4a00'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Acquiring lock "cinder-quobyte-02c47988-65bb-4122-af49-488cea8880e5" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Lock "cinder-quobyte-02c47988-65bb-4122-af49-488cea8880e5" acquired by "delete_volume" :: waited 0.045s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:41:56 devstack sudo[88707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:56 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7089258f-e079-4209-bb08-69f34ca212fc]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:56 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5
Apr 22 02:41:56 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:56 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.550s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:56 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Deleted volume successfully.
Apr 22 02:41:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9b47f16-0baf-4a4f-a2f5-37e673d1e244 tempest-CinderUnicodeTest-1934781945 None] Lock "cinder-0d6a23f3-e894-46bb-a97b-f254020e9c50-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:57 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.474s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Deleted volume successfully.
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:INSERT=43,cinder:UPDATE=168,cinder:SELECT=119,cinder:DELETE=10 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-99438b8c-e939-4adf-b978-4f0776ce73a5 tempest-VolumesCloneNegativeTest-540913650 None] Lock "cinder-1c41de2f-0f16-4088-8c80-bd2a12723849-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:57 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:57 devstack sudo[88716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5
Apr 22 02:41:57 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:57 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5" returned: 1 in 0.539s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:41:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:57 devstack sudo[88722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5
Apr 22 02:41:57 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:58 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-02c47988-65bb-4122-af49-488cea8880e5" returned: 0 in 0.548s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Lock "cinder-quobyte-02c47988-65bb-4122-af49-488cea8880e5" released by "delete_volume" :: held 1.653s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Created reservations ['b86703f6-c3a6-405e-bb3c-7a32093752b6', 'e0352e0f-f3b9-4ace-8cbc-de34445fc351', '3569c555-69f7-492c-a313-428bc36dfb21', '47adb96d-d86b-4c31-840c-7339aba1a066'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:41:58 devstack sudo[88726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:41:58 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:41:58 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:41:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Deleted volume successfully.
Apr 22 02:41:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c96bcb8d-f514-4833-8b20-d8f2d08292f7 tempest-VolumesImageMetadata-1090472648 None] Lock "cinder-02c47988-65bb-4122-af49-488cea8880e5-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:41:59 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:41:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Flow 'volume_create_manager' (205f1d00-3869-42ba-bead-56d60dca9bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:41:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ce3640-f09e-45f1-9233-deb003e6ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ce3640-f09e-45f1-9233-deb003e6ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-847109690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29a2d99-e7f4-49df-958b-6eb44a6a8e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b952c3e8594881ab7f79598afaba01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:00Z,use_quota=True,user_id='2fd54fbcfa9f41de84feeae89fee1195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bf050f-ef1e-4004-8901-edd06d5ae94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bf050f-ef1e-4004-8901-edd06d5ae94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:41:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e889cf1-4fca-4fa5-a887-b4dc0f58ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:41:59 devstack cinder-volume[82678]: DEBUG cinder.image.glance [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Creating Keystone auth plugin from conf {{(pid=82678) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e889cf1-4fca-4fa5-a887-b4dc0f58ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f29a2d99-e7f4-49df-958b-6eb44a6a8e13', 'volume_name': 'volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f69710dbb50>}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5760a7ef-973f-416a-8c9b-1de3b9297b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5760a7ef-973f-416a-8c9b-1de3b9297b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc9c689-13a4-475d-a6a0-aebeb5bbb351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:00 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Volume f29a2d99-e7f4-49df-958b-6eb44a6a8e13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f69710dbb50>}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Trying to clone f29a2d99-e7f4-49df-958b-6eb44a6a8e13 from image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]). {{(pid=82678) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 22 02:42:00 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Image download 20.69 MB at 20.69 MB/s
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7d6a0e-202b-49dc-b9c2-9bdb07771558]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:00 devstack sudo[88730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD
Apr 22 02:42:00 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Flow 'volume_create_manager' (3bddfdd2-e3dc-47f0-b531-24d0823adc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d397e72-4ba7-4a63-86f1-e24e460f90fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d397e72-4ba7-4a63-86f1-e24e460f90fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-340827598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a705a8a-a2bd-448a-89f9-978c72577bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205532ae6aca493a884b4f7a01e378a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:01Z,use_quota=True,user_id='0ceac95d15ff469d8fbdb857b2154b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f976db-71a3-4472-9bd1-6da34b091149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f976db-71a3-4472-9bd1-6da34b091149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d6778d-eaa6-4c7f-97ff-275256e5f58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d6778d-eaa6-4c7f-97ff-275256e5f58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a705a8a-a2bd-448a-89f9-978c72577bc8', 'volume_name': 'volume-2a705a8a-a2bd-448a-89f9-978c72577bc8', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2691c565-432b-4817-b731-b954753cefda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2691c565-432b-4817-b731-b954753cefda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8461325c-8255-44e9-883e-41b4ae5586d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:00 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Volume 2a705a8a-a2bd-448a-89f9-978c72577bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a705a8a-a2bd-448a-89f9-978c72577bc8', 'volume_size': 1}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-340827598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a705a8a-a2bd-448a-89f9-978c72577bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205532ae6aca493a884b4f7a01e378a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:01Z,use_quota=True,user_id='0ceac95d15ff469d8fbdb857b2154b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Creating volume 2a705a8a-a2bd-448a-89f9-978c72577bc8 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:00 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:00 devstack sudo[88732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 1073741824
Apr 22 02:42:00 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:00 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Temporary image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 is fetched for user 2fd54fbcfa9f41de84feeae89fee1195. {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1613519b-c381-429a-a507-95ba45757040]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:00 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD
Apr 22 02:42:00 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:01 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 1073741824" returned: 0 in 0.500s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:01 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8
Apr 22 02:42:01 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:01 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8" returned: 0 in 0.413s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:01 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-847109690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29a2d99-e7f4-49df-958b-6eb44a6a8e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b952c3e8594881ab7f79598afaba01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:00Z,use_quota=True,user_id='2fd54fbcfa9f41de84feeae89fee1195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Creating volume f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:01 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8461325c-8255-44e9-883e-41b4ae5586d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a705a8a-a2bd-448a-89f9-978c72577bc8', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:01 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 1073741824
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363926a1-3906-47e0-b8e9-4f8cf5d05f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:01 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:01 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Volume volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 (2a705a8a-a2bd-448a-89f9-978c72577bc8): created successfully
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363926a1-3906-47e0-b8e9-4f8cf5d05f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Flow 'volume_create_manager' (3bddfdd2-e3dc-47f0-b531-24d0823adc93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:01 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f2922071-e981-48bb-85f0-18560fd31d0e tempest-SnapshotMetadataTestJSON-1635686762 None] Created volume successfully.
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (f9d22e5b-dfba-433c-9dfc-97120a22ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251fd18f-58d3-40b0-adee-ed771554f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251fd18f-58d3-40b0-adee-ed771554f520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-702645209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26322126-fe1a-4ce1-b96e-5fa1f1558ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:02Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad041dd5-e845-41f9-ad58-b839c532078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad041dd5-e845-41f9-ad58-b839c532078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fc91c5-34f3-44b5-adc9-a0fb479bd3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fc91c5-34f3-44b5-adc9-a0fb479bd3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26322126-fe1a-4ce1-b96e-5fa1f1558ad3', 'volume_name': 'volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dbe4b11-f202-4fdf-b4e8-cc16430ca104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dbe4b11-f202-4fdf-b4e8-cc16430ca104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16f869f-d52e-4768-88ec-38f529d78ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:01 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Volume 26322126-fe1a-4ce1-b96e-5fa1f1558ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3', 'volume_size': 1}
Apr 22 02:42:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:02 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 1073741824" returned: 0 in 0.533s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:02 devstack sudo[88754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:02 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:02 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 0 in 0.417s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-702645209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26322126-fe1a-4ce1-b96e-5fa1f1558ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:02Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Creating volume 26322126-fe1a-4ce1-b96e-5fa1f1558ad3 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:02 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Attempting download of a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}])) to volume f29a2d99-e7f4-49df-958b-6eb44a6a8e13. {{(pid=82678) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 22 02:42:02 devstack sudo[88757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3 1073741824
Apr 22 02:42:02 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde22784-e3f9-4840-ab92-a54f1bdcee59]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_xgx1tx9q {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:02 devstack sudo[88759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_xgx1tx9q
Apr 22 02:42:02 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:03 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3 1073741824" returned: 0 in 0.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:03 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_xgx1tx9q" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_xgx1tx9q {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:03 devstack sudo[88767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3
Apr 22 02:42:03 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:03 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_xgx1tx9q
Apr 22 02:42:03 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:03 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3" returned: 0 in 0.421s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:03 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.761s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_xgx1tx9q" returned: 1 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_xgx1tx9q' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16f869f-d52e-4768-88ec-38f529d78ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8546015f-43b9-4fc8-833b-6f6aa0850857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc0256c-34bb-42d5-b111-6aba957d41b6]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Creating offline snapshot 680da22e-3d60-4929-b17e-3c4a2455a41c of volume 2a705a8a-a2bd-448a-89f9-978c72577bc8 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:42:03 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Volume volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3 (26322126-fe1a-4ce1-b96e-5fa1f1558ad3): created successfully
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8546015f-43b9-4fc8-833b-6f6aa0850857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (f9d22e5b-dfba-433c-9dfc-97120a22ca65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6269d3-9d8d-4753-b9e3-d6eb5246ada8]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-7c30e936-a34c-42ba-9f9b-6a9ebef5d7ee tempest-VolumesActionsTest-1058397490 None] Created volume successfully.
Apr 22 02:42:03 devstack sudo[88773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD
Apr 22 02:42:03 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:03 devstack sudo[88774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8
Apr 22 02:42:03 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-26322126-fe1a-4ce1-b96e-5fa1f1558ad3-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Lock "cinder-26322126-fe1a-4ce1-b96e-5fa1f1558ad3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-quobyte-26322126-fe1a-4ce1-b96e-5fa1f1558ad3" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Lock "cinder-quobyte-26322126-fe1a-4ce1-b96e-5fa1f1558ad3" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cc649b-da4b-4df1-af01-b855c5cad9bf]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:04 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD" returned: 0 in 0.494s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 was qcow2, converting to raw {{(pid=82678) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:04 devstack sudo[88784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:04 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:04 devstack sudo[88782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3
Apr 22 02:42:04 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:04 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8" returned: 0 in 0.540s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:04 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c 1G
Apr 22 02:42:04 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:04 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3" returned: 0 in 0.570s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:04 devstack sudo[88810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3
Apr 22 02:42:04 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:04 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c 1G" returned: 0 in 0.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:04 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c
Apr 22 02:42:04 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:04 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 0 in 0.840s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a9eb04c9-0b57-495a-bbe0-862e8ada6cd7_i2kygi3mdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:42:04 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Converted 112.00 MB image at 112.00 MB/s
Apr 22 02:42:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:04 devstack sudo[88814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 1G
Apr 22 02:42:04 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:05 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-26322126-fe1a-4ce1-b96e-5fa1f1558ad3" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Lock "cinder-quobyte-26322126-fe1a-4ce1-b96e-5fa1f1558ad3" released by "delete_volume" :: held 1.070s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Created reservations ['38de9ca5-c57c-4580-970a-21604e508473', 'a0943de7-9bac-40cc-b8d5-b055df5958a5', '41a43d7e-1f4f-4fea-99f4-034e07da575e', 'c6041dbb-8468-4914-a63d-1bcd5577c01a'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:05 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c" returned: 0 in 0.498s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:05 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c is being set with open permissions: ugo+rw
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:05 devstack sudo[88820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:05 devstack sudo[88820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:05 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:05 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:05 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 1G" returned: 0 in 0.454s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[9101efd3-95cf-428c-ac9a-8780bbc43cc2]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:05 devstack sudo[88827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:05 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:05 devstack sudo[88820]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c" returned: 0 in 0.411s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:05 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:05 devstack sudo[88831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.info
Apr 22 02:42:05 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.427s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:05 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Deleted volume successfully.
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-26739902-2336-429c-9ec5-f9040232d07d tempest-VolumesActionsTest-1136487812 None] Lock "cinder-26322126-fe1a-4ce1-b96e-5fa1f1558ad3-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:05 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:05 devstack sudo[88835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:05 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:06 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.info" returned: 0 in 0.417s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:06 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.info is being set with open permissions: ugo+rw
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:06 devstack sudo[88838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.info
Apr 22 02:42:06 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:06 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 1 in 0.471s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Downloaded image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 ((None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}])) to volume f29a2d99-e7f4-49df-958b-6eb44a6a8e13 successfully. {{(pid=82678) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Temporary image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 for user 2fd54fbcfa9f41de84feeae89fee1195 is deleted. {{(pid=82678) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.volume_utils [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Marking volume f29a2d99-e7f4-49df-958b-6eb44a6a8e13 as bootable. {{(pid=82678) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Copying metadata from image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 to f29a2d99-e7f4-49df-958b-6eb44a6a8e13. {{(pid=82678) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Creating volume glance metadata for volume f29a2d99-e7f4-49df-958b-6eb44a6a8e13 backed by image a9eb04c9-0b57-495a-bbe0-862e8ada6cd7 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82678) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc9c689-13a4-475d-a6a0-aebeb5bbb351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13', 'volume_size': 1, 'image_id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c4b30cae8a684ccf9394cb6bfd42388e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a9eb04c9-0b57-495a-bbe0-862e8ada6cd7', 'created_at': datetime.datetime(2026, 4, 22, 0, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 0, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a9eb04c9-0b57-495a-bbe0-862e8ada6cd7/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f69710dbb50>}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec859de-52de-45c0-92b7-81a5fdff2ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:06 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.info" returned: 0 in 0.434s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.954s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:06 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Volume volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 (f29a2d99-e7f4-49df-958b-6eb44a6a8e13): created successfully
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec859de-52de-45c0-92b7-81a5fdff2ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Flow 'volume_create_manager' (205f1d00-3869-42ba-bead-56d60dca9bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (6d8d90c9-c053-426e-a74e-4cd3c3b907ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29dae68d-999f-4305-b8d4-62240fd21025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29dae68d-999f-4305-b8d4-62240fd21025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2132366816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666882ff-a7a5-4766-b904-70289693414f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:06Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cea71b-31c1-471d-b9dc-94aba6d3dec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cea71b-31c1-471d-b9dc-94aba6d3dec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533a2f29-7548-4bdd-bfcb-71995dd48e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533a2f29-7548-4bdd-bfcb-71995dd48e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666882ff-a7a5-4766-b904-70289693414f', 'volume_name': 'volume-666882ff-a7a5-4766-b904-70289693414f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69f5d2c-5d49-408f-beed-20299c9a309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d69f5d2c-5d49-408f-beed-20299c9a309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288b3944-739a-4012-b9f4-fd8f54369b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:06 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Volume 666882ff-a7a5-4766-b904-70289693414f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666882ff-a7a5-4766-b904-70289693414f', 'volume_size': 1}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2132366816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666882ff-a7a5-4766-b904-70289693414f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:06Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Creating volume 666882ff-a7a5-4766-b904-70289693414f {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:06 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:06 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f233a7dc-00f7-4f6a-8475-c186d8e8591c tempest-VolumesExtendTest-647357991 None] Created volume successfully.
Apr 22 02:42:06 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f 1073741824
Apr 22 02:42:06 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:06 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-41bcaf6d-ede5-483c-aa7a-bca193773021 tempest-SnapshotMetadataTestJSON-1635686762 None] Create snapshot completed successfully
Apr 22 02:42:07 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f 1073741824" returned: 0 in 0.513s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:07 devstack sudo[88849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f
Apr 22 02:42:07 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "cinder-680da22e-3d60-4929-b17e-3c4a2455a41c-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-680da22e-3d60-4929-b17e-3c4a2455a41c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "cinder-quobyte-2a705a8a-a2bd-448a-89f9-978c72577bc8" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-quobyte-2a705a8a-a2bd-448a-89f9-978c72577bc8" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "cinder-quobyte-680da22e-3d60-4929-b17e-3c4a2455a41c" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-quobyte-680da22e-3d60-4929-b17e-3c4a2455a41c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Deleting offline snapshot 680da22e-3d60-4929-b17e-3c4a2455a41c of volume 2a705a8a-a2bd-448a-89f9-978c72577bc8 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] snapshot_file for this snap is: volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d348f4c-c6c7-47c0-a6d1-b3361121c777]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:07 devstack sudo[88851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c
Apr 22 02:42:07 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:07 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f" returned: 0 in 0.459s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.447s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288b3944-739a-4012-b9f4-fd8f54369b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666882ff-a7a5-4766-b904-70289693414f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383390e2-e5bd-4f69-8edd-a7bb2576f136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3eedaf-7658-4597-aa57-7524fe6283ce]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:07 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Volume volume-666882ff-a7a5-4766-b904-70289693414f (666882ff-a7a5-4766-b904-70289693414f): created successfully
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383390e2-e5bd-4f69-8edd-a7bb2576f136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (6d8d90c9-c053-426e-a74e-4cd3c3b907ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2dee699d-5673-48e4-b25b-35275e33dace tempest-VolumesActionsTest-1058397490 None] Created volume successfully.
Apr 22 02:42:07 devstack sudo[88854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:07 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:07 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c" returned: 0 in 0.473s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a705a8a-a2bd-448a-89f9-978c72577bc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ea85b3-554a-4975-bf9d-027af7628243]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:08 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8
Apr 22 02:42:08 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:08 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 0 in 0.468s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:08 devstack sudo[88863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:08 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:08 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8" returned: 0 in 0.468s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:08 devstack sudo[88868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c
Apr 22 02:42:08 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:08 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 1 in 0.520s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 2G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-666882ff-a7a5-4766-b904-70289693414f-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 2G" returned: 0 in 0.054s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.082s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Lock "cinder-666882ff-a7a5-4766-b904-70289693414f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-quobyte-666882ff-a7a5-4766-b904-70289693414f" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:08 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6f9ce64e-186c-4de8-96f7-eede2ef8b2a3 tempest-VolumesExtendTest-647357991 None] Extend volume completed successfully.
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Lock "cinder-quobyte-666882ff-a7a5-4766-b904-70289693414f" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c8cfe5-e139-4fc5-a412-20a30182c569]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:08 devstack sudo[88876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f
Apr 22 02:42:08 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:08 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:08 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c
Apr 22 02:42:08 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:09 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f" returned: 0 in 0.465s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:09 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f
Apr 22 02:42:09 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:09 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8.680da22e-3d60-4929-b17e-3c4a2455a41c" returned: 0 in 0.427s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-quobyte-680da22e-3d60-4929-b17e-3c4a2455a41c" released by "_delete_snapshot" :: held 1.917s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-quobyte-2a705a8a-a2bd-448a-89f9-978c72577bc8" released by "delete_snapshot" :: held 1.928s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Created reservations ['be03e8f9-9771-4320-95ee-03c974489a51', '8649b953-62d5-48cc-a636-1fc4b5f0cd56', '50ff79be-2ff5-462d-bcbe-45d1d7d69fcf', '8de8da25-d68e-4080-b836-007ea2cf7771'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Acquiring lock "cinder-f29a2d99-e7f4-49df-958b-6eb44a6a8e13-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Lock "cinder-f29a2d99-e7f4-49df-958b-6eb44a6a8e13-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:09 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Delete snapshot completed successfully.
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a2ecb0fa-0ac2-4b46-a728-da54ef718210 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-680da22e-3d60-4929-b17e-3c4a2455a41c-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Acquiring lock "cinder-quobyte-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Lock "cinder-quobyte-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473f91a-6f1e-44b9-a7b3-9288f9985c27]: (4, 'raw') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "cinder-2a705a8a-a2bd-448a-89f9-978c72577bc8-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-2a705a8a-a2bd-448a-89f9-978c72577bc8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:09 devstack sudo[88889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:09 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "cinder-quobyte-2a705a8a-a2bd-448a-89f9-978c72577bc8" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-quobyte-2a705a8a-a2bd-448a-89f9-978c72577bc8" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[930868cc-6d74-46ac-9ad1-a29d98da8123]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:09 devstack sudo[88891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8
Apr 22 02:42:09 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:09 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-666882ff-a7a5-4766-b904-70289693414f" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Lock "cinder-quobyte-666882ff-a7a5-4766-b904-70289693414f" released by "delete_volume" :: held 0.992s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Created reservations ['ec1b136c-4fa7-46bc-8eea-4313e145d8cb', '476f84e5-87d2-4848-95a0-75b234fc4fee', '61fad22b-f50f-42c4-a137-321d820741bb', '003e3702-cb4a-4b91-bdff-3921a6ccc4b2'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:09 devstack sudo[88894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:09 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:10 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 0 in 0.506s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:10 devstack sudo[88898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:10 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:10 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8" returned: 0 in 0.487s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:10 devstack sudo[88903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8
Apr 22 02:42:10 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:10 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.419s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:10 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Deleted volume successfully.
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-56c3e052-f708-4e55-bf56-3cebfcbb8c6c tempest-VolumesActionsTest-1136487812 None] Lock "cinder-666882ff-a7a5-4766-b904-70289693414f-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:10 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 1 in 0.500s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13' failed. Not Retrying. {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:10 devstack sudo[88910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13
Apr 22 02:42:10 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:10 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2a705a8a-a2bd-448a-89f9-978c72577bc8" returned: 0 in 0.423s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-quobyte-2a705a8a-a2bd-448a-89f9-978c72577bc8" released by "delete_volume" :: held 0.937s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Created reservations ['d9b0d5f7-c357-4c74-a096-9273df5e32c8', 'e60589bf-1253-4824-90ac-c1a99f8be04d', '32484902-cf1d-4a2a-a1ef-501003e9ff15', 'b44adac3-ba99-4739-ad92-118c0cab6313'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:10 devstack sudo[88912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:10 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:11 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Lock "cinder-quobyte-f29a2d99-e7f4-49df-958b-6eb44a6a8e13" released by "delete_volume" :: held 1.549s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Created reservations ['4d556971-0cea-4520-8097-290d60a638be', '8f394e67-3348-4e52-8b8a-9db4769a7634', '89292517-adde-43ac-bc8a-842fea8ff046', '0168b72c-48be-45dc-8103-1f5e7d22c359'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:11 devstack sudo[88916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:11 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:11 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.526s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:11 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Deleted volume successfully.
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (3df115d3-a64e-48d5-ae7e-3879f73b0e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b8b579-6468-4b23-94be-d8e71f53005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e7ef80ee-a839-42c1-8525-87e189de8384 tempest-SnapshotMetadataTestJSON-1635686762 None] Lock "cinder-2a705a8a-a2bd-448a-89f9-978c72577bc8-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b8b579-6468-4b23-94be-d8e71f53005c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-906061820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b91f429-d846-424d-8883-0eb3417f4528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:11Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f05d09-c0ca-49a9-b984-15d9c2eabf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f05d09-c0ca-49a9-b984-15d9c2eabf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211c7b95-7cb6-4d98-a954-d39999dbc79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211c7b95-7cb6-4d98-a954-d39999dbc79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b91f429-d846-424d-8883-0eb3417f4528', 'volume_name': 'volume-0b91f429-d846-424d-8883-0eb3417f4528', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec7a3b7-9fab-49c7-9dd7-b9aa864527ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec7a3b7-9fab-49c7-9dd7-b9aa864527ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add61129-ecfb-4097-94a6-8af5392da1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Volume 0b91f429-d846-424d-8883-0eb3417f4528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b91f429-d846-424d-8883-0eb3417f4528', 'volume_size': 1}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-906061820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b91f429-d846-424d-8883-0eb3417f4528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:11Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Creating volume 0b91f429-d846-424d-8883-0eb3417f4528 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:11 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:11 devstack sudo[88918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528 1073741824
Apr 22 02:42:11 devstack sudo[88918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:11 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.534s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:11 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Deleted volume successfully.
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-354045c6-c728-4ca9-a4b5-6326213ff372 tempest-VolumesExtendTest-647357991 None] Lock "cinder-f29a2d99-e7f4-49df-958b-6eb44a6a8e13-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Flow 'volume_create_manager' (b174c39b-1bbd-4ad7-a2c8-8f78a1afb1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ade614-28e6-4b7d-9d65-cc201e8de8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ade614-28e6-4b7d-9d65-cc201e8de8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1791624787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b952c3e8594881ab7f79598afaba01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:12Z,use_quota=True,user_id='2fd54fbcfa9f41de84feeae89fee1195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d74865-b620-4161-993b-42469d90c78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d74865-b620-4161-993b-42469d90c78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a8c316-c168-48bb-a48b-43c3bb2f7de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a8c316-c168-48bb-a48b-43c3bb2f7de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2', 'volume_name': 'volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b700f71d-b87b-4194-9c9c-4fe5a43de22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack sudo[88918]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b700f71d-b87b-4194-9c9c-4fe5a43de22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcb92c0-7d9f-4903-a84c-343a1b735b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:11 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Volume b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2', 'volume_size': 1}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528 1073741824" returned: 0 in 0.599s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:11 devstack sudo[88925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528
Apr 22 02:42:11 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:12 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528" returned: 0 in 0.423s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1791624787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b952c3e8594881ab7f79598afaba01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:12Z,use_quota=True,user_id='2fd54fbcfa9f41de84feeae89fee1195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Creating volume b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:12 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add61129-ecfb-4097-94a6-8af5392da1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b91f429-d846-424d-8883-0eb3417f4528', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be10bc27-0dff-4e0f-a3d7-cbd784e478eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:12 devstack sudo[88928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 1073741824
Apr 22 02:42:12 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:12 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Volume volume-0b91f429-d846-424d-8883-0eb3417f4528 (0b91f429-d846-424d-8883-0eb3417f4528): created successfully
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be10bc27-0dff-4e0f-a3d7-cbd784e478eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (3df115d3-a64e-48d5-ae7e-3879f73b0e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:12 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a108775b-2c10-43c1-846a-40b8b8ff9dd8 tempest-VolumesActionsTest-1058397490 None] Created volume successfully.
Apr 22 02:42:12 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 1073741824" returned: 0 in 0.530s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:12 devstack sudo[88939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2
Apr 22 02:42:12 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:13 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" returned: 0 in 0.474s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcb92c0-7d9f-4903-a84c-343a1b735b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685613dd-65ae-433c-899c-31fc811168da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:13 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Volume volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 (b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2): created successfully
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685613dd-65ae-433c-899c-31fc811168da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Flow 'volume_create_manager' (b174c39b-1bbd-4ad7-a2c8-8f78a1afb1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-0b91f429-d846-424d-8883-0eb3417f4528-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:13 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-27a86068-3712-49cf-a520-4a68e440cd08 tempest-VolumesExtendTest-647357991 None] Created volume successfully.
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Lock "cinder-0b91f429-d846-424d-8883-0eb3417f4528-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-quobyte-0b91f429-d846-424d-8883-0eb3417f4528" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Lock "cinder-quobyte-0b91f429-d846-424d-8883-0eb3417f4528" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c2e703-88c2-4c4d-b7c3-5dea8f33c39e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:13 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528
Apr 22 02:42:13 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Flow 'volume_create_manager' (f3ca9b53-3005-45b1-8ea8-aa5b64969564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f88feb-9118-4221-86a1-f813ab971611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f88feb-9118-4221-86a1-f813ab971611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-130519144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7e7aca-7643-4686-852f-9b9ec1727227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d87f2cc589466ebc9010befdd449ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:14Z,use_quota=True,user_id='26479328e71541d196bee2f38e03c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6527dd4b-f9fa-4257-a108-2315ebd68b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6527dd4b-f9fa-4257-a108-2315ebd68b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28656633-0950-49eb-b80e-df3bf6f70fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28656633-0950-49eb-b80e-df3bf6f70fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7e7aca-7643-4686-852f-9b9ec1727227', 'volume_name': 'volume-7b7e7aca-7643-4686-852f-9b9ec1727227', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6b1cca-45a4-47f3-93b1-df65bc4404a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6b1cca-45a4-47f3-93b1-df65bc4404a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fd7558-53d9-4f3b-87bd-5ab531cc3fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:13 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Volume 7b7e7aca-7643-4686-852f-9b9ec1727227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7e7aca-7643-4686-852f-9b9ec1727227', 'volume_size': 1}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-130519144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7e7aca-7643-4686-852f-9b9ec1727227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d87f2cc589466ebc9010befdd449ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:14Z,use_quota=True,user_id='26479328e71541d196bee2f38e03c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Creating volume 7b7e7aca-7643-4686-852f-9b9ec1727227 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:13 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:14 devstack sudo[88949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227 1073741824
Apr 22 02:42:14 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:14 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528" returned: 0 in 0.551s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:14 devstack sudo[88951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528
Apr 22 02:42:14 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:14 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0b91f429-d846-424d-8883-0eb3417f4528" returned: 0 in 0.446s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Lock "cinder-quobyte-0b91f429-d846-424d-8883-0eb3417f4528" released by "delete_volume" :: held 1.028s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Created reservations ['80fd77be-95e4-4e63-b810-76f68b492a63', '2a6426ee-3a00-49c3-bfa6-666a28ef08e4', 'bf549895-4576-4dbd-b187-cb86cc1a06c0', '21d2fff4-6509-45ee-a1e8-eaee6f333bbc'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:14 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227 1073741824" returned: 0 in 0.562s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:14 devstack sudo[88957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:14 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:14 devstack sudo[88959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227
Apr 22 02:42:14 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:14 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.409s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:14 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Deleted volume successfully.
Apr 22 02:42:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1d7382ba-a915-4492-9ec7-da534fdc196d tempest-VolumesActionsTest-1136487812 None] Lock "cinder-0b91f429-d846-424d-8883-0eb3417f4528-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:15 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227" returned: 0 in 0.415s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.934s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Creating offline snapshot 809f9d0e-29c0-4633-a73e-1770cd1d253b of volume b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fd7558-53d9-4f3b-87bd-5ab531cc3fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7e7aca-7643-4686-852f-9b9ec1727227', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9751affd-b3e4-4d6b-85ee-1a8be40ca4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ddcf49-ff4b-4702-9b7e-8c2a7dd2db94]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:15 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Volume volume-7b7e7aca-7643-4686-852f-9b9ec1727227 (7b7e7aca-7643-4686-852f-9b9ec1727227): created successfully
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9751affd-b3e4-4d6b-85ee-1a8be40ca4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Flow 'volume_create_manager' (f3ca9b53-3005-45b1-8ea8-aa5b64969564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:15 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-dd549616-1c47-450b-a7c0-311fbe26ccd0 tempest-VolumesNegativeTest-1968731111 None] Created volume successfully.
Apr 22 02:42:15 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2
Apr 22 02:42:15 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:15 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" returned: 0 in 0.466s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:15 devstack sudo[88968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b 1G
Apr 22 02:42:15 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (47b19674-27c7-4727-aef2-27dbf1f6bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4299ca-8c4b-4089-9f25-c03348cb8d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4299ca-8c4b-4089-9f25-c03348cb8d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1241370257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9539177b-e6d0-4007-ad2e-60b05f1de18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:16Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e358315f-fe1f-4254-81c0-1be02091f70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e358315f-fe1f-4254-81c0-1be02091f70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f280d43-9a18-4945-be68-c847c3c312bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f280d43-9a18-4945-be68-c847c3c312bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9539177b-e6d0-4007-ad2e-60b05f1de18b', 'volume_name': 'volume-9539177b-e6d0-4007-ad2e-60b05f1de18b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda0e857-de0e-4fa7-bc57-9c38d61ba69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda0e857-de0e-4fa7-bc57-9c38d61ba69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a642dfd6-bd89-4adf-b7c5-2e6fcdf938fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:15 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Volume 9539177b-e6d0-4007-ad2e-60b05f1de18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9539177b-e6d0-4007-ad2e-60b05f1de18b', 'volume_size': 1}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:15 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b 1G" returned: 0 in 0.484s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:16 devstack sudo[88973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b
Apr 22 02:42:16 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:16 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:16 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b is being set with open permissions: ugo+rw
Apr 22 02:42:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:16 devstack sudo[88981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b
Apr 22 02:42:16 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:16 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:16 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.info
Apr 22 02:42:16 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:17 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.info" returned: 0 in 0.416s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:17 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.info is being set with open permissions: ugo+rw
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:17 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.info
Apr 22 02:42:17 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:17 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.info" returned: 0 in 0.419s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.796s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1241370257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9539177b-e6d0-4007-ad2e-60b05f1de18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:16Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Creating volume 9539177b-e6d0-4007-ad2e-60b05f1de18b {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:17 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:17 devstack sudo[88991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b 1073741824
Apr 22 02:42:17 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:17 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-65f1c6cd-4d49-4664-8c10-06d7ba5d5a6d tempest-VolumesExtendTest-647357991 None] Create snapshot completed successfully
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf92eafd-8e74-41dc-9f24-5113fd6041f6 tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:18 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b 1073741824" returned: 0 in 0.511s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:18 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b
Apr 22 02:42:18 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:18 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b" returned: 0 in 0.413s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf92eafd-8e74-41dc-9f24-5113fd6041f6 tempest-VolumesExtendTest-647357991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.482s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d6552f-a5d7-4e5c-992c-48f26d62d85f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf92eafd-8e74-41dc-9f24-5113fd6041f6 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a642dfd6-bd89-4adf-b7c5-2e6fcdf938fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9539177b-e6d0-4007-ad2e-60b05f1de18b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7f5207-ad94-4263-a60f-726f33637389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:18 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Volume volume-9539177b-e6d0-4007-ad2e-60b05f1de18b (9539177b-e6d0-4007-ad2e-60b05f1de18b): created successfully
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7f5207-ad94-4263-a60f-726f33637389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:18 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (47b19674-27c7-4727-aef2-27dbf1f6bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:18 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-49ca770a-d99a-4674-ab47-47786d0265ea tempest-VolumesActionsTest-1058397490 None] Created volume successfully.
Apr 22 02:42:18 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2
Apr 22 02:42:18 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-9539177b-e6d0-4007-ad2e-60b05f1de18b-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Lock "cinder-9539177b-e6d0-4007-ad2e-60b05f1de18b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Acquiring lock "cinder-quobyte-9539177b-e6d0-4007-ad2e-60b05f1de18b" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Lock "cinder-quobyte-9539177b-e6d0-4007-ad2e-60b05f1de18b" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a16b0-2ea8-44a5-b280-d27ae647ba17]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:19 devstack sudo[89035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b
Apr 22 02:42:19 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:19 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf92eafd-8e74-41dc-9f24-5113fd6041f6 tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf92eafd-8e74-41dc-9f24-5113fd6041f6 tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b 2G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf92eafd-8e74-41dc-9f24-5113fd6041f6 tempest-VolumesExtendTest-647357991 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b 2G" returned: 0 in 0.069s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf92eafd-8e74-41dc-9f24-5113fd6041f6 tempest-VolumesExtendTest-647357991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.590s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:19 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-cf92eafd-8e74-41dc-9f24-5113fd6041f6 tempest-VolumesExtendTest-647357991 None] Extend volume completed successfully.
Apr 22 02:42:19 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b" returned: 0 in 0.513s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:19 devstack sudo[89046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b
Apr 22 02:42:19 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:20 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-9539177b-e6d0-4007-ad2e-60b05f1de18b" returned: 0 in 0.399s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Lock "cinder-quobyte-9539177b-e6d0-4007-ad2e-60b05f1de18b" released by "delete_volume" :: held 0.932s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Created reservations ['0ab06156-8bfc-4d88-b583-c948e17d8ed5', '0eeda152-5a4f-4bd3-ac3a-8c12f5da414d', 'dafbce9e-c881-4d5a-8599-ba05eae8331e', '3211e456-0a93-4b2c-a929-7bf3283b06a5'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:20 devstack sudo[89049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:20 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (aacd122b-7319-4113-befe-6d27a32d72b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f669d5ef-83ac-4204-b6e3-b2db0ef85f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f669d5ef-83ac-4204-b6e3-b2db0ef85f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1356686818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4c3dab-46df-4167-9d8e-ad78696d711e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:20Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f311651-b033-4339-982a-53c40af05eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f311651-b033-4339-982a-53c40af05eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ba3c60-9d16-47f9-925b-11c31e6ea069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ba3c60-9d16-47f9-925b-11c31e6ea069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b4c3dab-46df-4167-9d8e-ad78696d711e', 'volume_name': 'volume-5b4c3dab-46df-4167-9d8e-ad78696d711e', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01da5726-4851-47ce-bcc8-2ed77947b68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01da5726-4851-47ce-bcc8-2ed77947b68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef27c0e-63ba-4a83-8acf-af16c0870613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:20 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Volume 5b4c3dab-46df-4167-9d8e-ad78696d711e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b4c3dab-46df-4167-9d8e-ad78696d711e', 'volume_size': 1}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1356686818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b4c3dab-46df-4167-9d8e-ad78696d711e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce4b3774004ab586c49281d020467f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:20Z,use_quota=True,user_id='3c0f81d555e040afa067386883d9cb73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Creating volume 5b4c3dab-46df-4167-9d8e-ad78696d711e {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:20 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Acquiring lock "cinder-809f9d0e-29c0-4633-a73e-1770cd1d253b-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:20 devstack sudo[89052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e 1073741824
Apr 22 02:42:20 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Lock "cinder-809f9d0e-29c0-4633-a73e-1770cd1d253b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Acquiring lock "cinder-quobyte-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Lock "cinder-quobyte-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Acquiring lock "cinder-quobyte-809f9d0e-29c0-4633-a73e-1770cd1d253b" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Lock "cinder-quobyte-809f9d0e-29c0-4633-a73e-1770cd1d253b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Deleting offline snapshot 809f9d0e-29c0-4633-a73e-1770cd1d253b of volume b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] snapshot_file for this snap is: volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f7a402-c78d-4286-a126-211ea64d3ec0]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:20 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:20 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Deleted volume successfully.
Apr 22 02:42:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d5f3bd2a-1e7b-4b15-b632-04c30beb06ab tempest-VolumesActionsTest-1136487812 None] Lock "cinder-9539177b-e6d0-4007-ad2e-60b05f1de18b-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:20 devstack sudo[89054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b
Apr 22 02:42:20 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:21 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e 1073741824" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:21 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e
Apr 22 02:42:21 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:21 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b" returned: 0 in 0.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[479caee2-0b8d-44b9-850f-db086e347a63]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:21 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2
Apr 22 02:42:21 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:21 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef27c0e-63ba-4a83-8acf-af16c0870613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b4c3dab-46df-4167-9d8e-ad78696d711e', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2a4ba2-29be-48a4-aff5-8c12a45f51b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Volume volume-5b4c3dab-46df-4167-9d8e-ad78696d711e (5b4c3dab-46df-4167-9d8e-ad78696d711e): created successfully
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2a4ba2-29be-48a4-aff5-8c12a45f51b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Flow 'volume_create_manager' (aacd122b-7319-4113-befe-6d27a32d72b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:21 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2db6f04c-5fd1-4534-b487-246472e43e3c tempest-VolumesActionsTest-1058397490 None] Created volume successfully.
Apr 22 02:42:21 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" returned: 0 in 0.547s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:21 devstack sudo[89071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b
Apr 22 02:42:21 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:22 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b" returned: 0 in 0.528s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:22 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b
Apr 22 02:42:22 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:22 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2.809f9d0e-29c0-4633-a73e-1770cd1d253b" returned: 0 in 0.446s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Lock "cinder-quobyte-809f9d0e-29c0-4633-a73e-1770cd1d253b" released by "_delete_snapshot" :: held 2.125s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Lock "cinder-quobyte-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" released by "delete_snapshot" :: held 2.144s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:22 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Created reservations ['f4082ab6-54d5-4b62-9ba9-e05d11cba7fa', '9d807778-e70e-4d46-877a-f919565dffd9', '621d90a2-29b7-4f83-85fc-532bb4214bf9', '2c662854-1035-4c6a-8f69-c2f615f40096'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:22 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Delete snapshot completed successfully.
Apr 22 02:42:22 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-188b3a46-31ea-44d3-8b0f-2baab1dfe4ae tempest-VolumesExtendTest-647357991 None] Lock "cinder-809f9d0e-29c0-4633-a73e-1770cd1d253b-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Acquiring lock "cinder-5b4c3dab-46df-4167-9d8e-ad78696d711e-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Lock "cinder-5b4c3dab-46df-4167-9d8e-ad78696d711e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Acquiring lock "cinder-quobyte-5b4c3dab-46df-4167-9d8e-ad78696d711e" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Lock "cinder-quobyte-5b4c3dab-46df-4167-9d8e-ad78696d711e" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf116c0f-8892-4dca-b1a4-10761f7acea2]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:23 devstack sudo[89095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e
Apr 22 02:42:23 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:23 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e" returned: 0 in 0.486s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:23 devstack sudo[89100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e
Apr 22 02:42:23 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Acquiring lock "cinder-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Lock "cinder-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Acquiring lock "cinder-quobyte-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Lock "cinder-quobyte-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca9ba3a-4b10-4ad3-aed9-9c0ff9403368]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:23 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2
Apr 22 02:42:23 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:23 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b4c3dab-46df-4167-9d8e-ad78696d711e" returned: 0 in 0.422s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Lock "cinder-quobyte-5b4c3dab-46df-4167-9d8e-ad78696d711e" released by "delete_volume" :: held 0.935s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Created reservations ['8c91fa52-b171-47d3-a9a3-70c1b18993a9', 'c112f89b-643c-4e17-8e13-5738143f622f', '2edc4d7f-3c13-4257-9de4-341bf3653389', '8d536d4f-b5ed-4b1b-9885-0d3ead6ca562'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:24 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:24 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:24 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:24 devstack sudo[89110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2
Apr 22 02:42:24 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:24 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.503s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:24 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Deleted volume successfully.
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2310912-cc1a-4c90-b85a-447d612d67f9 tempest-VolumesActionsTest-1058397490 None] Lock "cinder-5b4c3dab-46df-4167-9d8e-ad78696d711e-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:24 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Lock "cinder-quobyte-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2" released by "delete_volume" :: held 1.009s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Created reservations ['e4dfa967-59b7-488c-a24b-dfcc536c917a', '90e6659a-3d48-48d1-b90c-a21a8947a3b6', '13eb95cd-8ff7-475a-919f-fc23e1f48f74', 'ec307b4f-c888-43da-a0a2-a58a2e88cbd3'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:24 devstack sudo[89114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:24 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:25 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.474s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:25 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:25 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Deleted volume successfully.
Apr 22 02:42:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8373325c-354f-422d-9341-482f65f29d7b tempest-VolumesExtendTest-647357991 None] Lock "cinder-b1ee9b10-4c41-4f8f-b5d1-2f16d7cfbaf2-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:29 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=168,cinder:UPDATE=204,cinder:DELETE=18,cinder:INSERT=59 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:42:29 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Flow 'volume_create_manager' (4832afa6-dbea-4277-9318-93245911f43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e33257-50bb-4a68-87af-c6e94013aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e33257-50bb-4a68-87af-c6e94013aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2052683062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06872943-b94d-44e8-9266-03c087f9bd54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acfdeb7846f3477b95b319a5ffff037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:30Z,use_quota=True,user_id='4c82a4cc53e84a7083d6f1d16cdd9c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7882f7a3-179d-425f-9809-610d4dfe6870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7882f7a3-179d-425f-9809-610d4dfe6870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349e3c7e-c8d2-404f-9306-d3f44e5f9327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349e3c7e-c8d2-404f-9306-d3f44e5f9327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06872943-b94d-44e8-9266-03c087f9bd54', 'volume_name': 'volume-06872943-b94d-44e8-9266-03c087f9bd54', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2a0b0d-2dc3-481c-bb84-fe9429996686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2a0b0d-2dc3-481c-bb84-fe9429996686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c43d48-0efb-4fcb-afe0-6ca2405aae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:30 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Volume 06872943-b94d-44e8-9266-03c087f9bd54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06872943-b94d-44e8-9266-03c087f9bd54', 'volume_size': 1}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2052683062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06872943-b94d-44e8-9266-03c087f9bd54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acfdeb7846f3477b95b319a5ffff037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:30Z,use_quota=True,user_id='4c82a4cc53e84a7083d6f1d16cdd9c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Creating volume 06872943-b94d-44e8-9266-03c087f9bd54 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:30 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:30 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54 1073741824
Apr 22 02:42:30 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:30 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54 1073741824" returned: 0 in 0.680s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:30 devstack sudo[89158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54
Apr 22 02:42:30 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:31 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c43d48-0efb-4fcb-afe0-6ca2405aae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06872943-b94d-44e8-9266-03c087f9bd54', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80d72d8-331d-4a5a-9072-30b6827f456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:31 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Volume volume-06872943-b94d-44e8-9266-03c087f9bd54 (06872943-b94d-44e8-9266-03c087f9bd54): created successfully
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80d72d8-331d-4a5a-9072-30b6827f456a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Flow 'volume_create_manager' (4832afa6-dbea-4277-9318-93245911f43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-abd48c55-67eb-4b34-9597-de67db9b9e5c tempest-VolumesListTestJSON-462294457 None] Created volume successfully.
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:31 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:31 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:31 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.465s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Flow 'volume_create_manager' (76b7e0d8-4de6-4115-9030-5503189354a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddc7610-f5eb-4837-9b07-a9b3a2d6043f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddc7610-f5eb-4837-9b07-a9b3a2d6043f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-243643926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acfdeb7846f3477b95b319a5ffff037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:32Z,use_quota=True,user_id='4c82a4cc53e84a7083d6f1d16cdd9c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c76a1c-6bf9-48b8-9694-7c3bdcf44b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c76a1c-6bf9-48b8-9694-7c3bdcf44b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ff6a67-49a4-43ba-b31d-dd9bf211298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9ff6a67-49a4-43ba-b31d-dd9bf211298d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be', 'volume_name': 'volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75867bd3-3b93-4131-9178-58215cd257b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75867bd3-3b93-4131-9178-58215cd257b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4558e656-014d-48bd-b112-a609d68d83ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:32 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Volume b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be', 'volume_size': 1}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-243643926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acfdeb7846f3477b95b319a5ffff037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:32Z,use_quota=True,user_id='4c82a4cc53e84a7083d6f1d16cdd9c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Creating volume b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:32 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:32 devstack sudo[89194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be 1073741824
Apr 22 02:42:32 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Flow 'volume_create_manager' (04d29d6e-5c6c-43c3-a8b9-60710b6304d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f9334d-58e7-4947-8e31-9c7768c6c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f9334d-58e7-4947-8e31-9c7768c6c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1444978561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee47cd62-9e08-41de-8a21-f81f3c284f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84e5a0928d647c0ae2e456ddff19d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:33Z,use_quota=True,user_id='c11054c87ca34e6ab00b6183f307f960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6ce4dd-7284-4e35-8285-34d419ffe34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6ce4dd-7284-4e35-8285-34d419ffe34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e4953c-b74f-4f80-9ba2-44be18844b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e4953c-b74f-4f80-9ba2-44be18844b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee47cd62-9e08-41de-8a21-f81f3c284f84', 'volume_name': 'volume-ee47cd62-9e08-41de-8a21-f81f3c284f84', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03f13a8-7a31-4318-a82e-84bc77f3ee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03f13a8-7a31-4318-a82e-84bc77f3ee0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64f628f-90b1-4ac9-a9fb-010d422a193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:33 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Volume ee47cd62-9e08-41de-8a21-f81f3c284f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee47cd62-9e08-41de-8a21-f81f3c284f84', 'volume_size': 1}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:33 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be 1073741824" returned: 0 in 0.552s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:33 devstack sudo[89200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be
Apr 22 02:42:33 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:33 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be" returned: 0 in 0.425s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1444978561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee47cd62-9e08-41de-8a21-f81f3c284f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a84e5a0928d647c0ae2e456ddff19d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:33Z,use_quota=True,user_id='c11054c87ca34e6ab00b6183f307f960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Creating volume ee47cd62-9e08-41de-8a21-f81f3c284f84 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:33 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4558e656-014d-48bd-b112-a609d68d83ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:33 devstack sudo[89203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84 1073741824
Apr 22 02:42:33 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bd2ed6-278f-4473-937e-2861151414de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:33 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Volume volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be (b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be): created successfully
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bd2ed6-278f-4473-937e-2861151414de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Flow 'volume_create_manager' (76b7e0d8-4de6-4115-9030-5503189354a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:33 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-003cee65-cf6c-43fc-9a67-df963194164a tempest-VolumesListTestJSON-462294457 None] Created volume successfully.
Apr 22 02:42:34 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84 1073741824" returned: 0 in 0.499s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:34 devstack sudo[89208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84
Apr 22 02:42:34 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:34 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84" returned: 0 in 0.408s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a64f628f-90b1-4ac9-a9fb-010d422a193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee47cd62-9e08-41de-8a21-f81f3c284f84', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7e1deb-c76d-41d7-80f1-7b3bf66e8860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:34 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Volume volume-ee47cd62-9e08-41de-8a21-f81f3c284f84 (ee47cd62-9e08-41de-8a21-f81f3c284f84): created successfully
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7e1deb-c76d-41d7-80f1-7b3bf66e8860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Flow 'volume_create_manager' (04d29d6e-5c6c-43c3-a8b9-60710b6304d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:34 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-fba8de65-4df3-4b50-94f9-f55ea1238e5a tempest-AbsoluteLimitsTests-1732561624 None] Created volume successfully.
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Flow 'volume_create_manager' (0ca3d423-6c86-4ced-bc08-832017a768d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a4c234-250f-4f39-a944-a7f2b0efc889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a4c234-250f-4f39-a944-a7f2b0efc889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-783726480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae86455-cbab-4eb7-b83e-36a79e72ce59,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acfdeb7846f3477b95b319a5ffff037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:35Z,use_quota=True,user_id='4c82a4cc53e84a7083d6f1d16cdd9c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490f3c09-31c0-4e12-844d-7d2968d5720d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490f3c09-31c0-4e12-844d-7d2968d5720d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23433c85-85dd-4f21-aac8-050a6b8df816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23433c85-85dd-4f21-aac8-050a6b8df816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ae86455-cbab-4eb7-b83e-36a79e72ce59', 'volume_name': 'volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2528afe0-02b5-4e6a-bb37-c8693a99fe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2528afe0-02b5-4e6a-bb37-c8693a99fe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037563cd-fb40-41b3-a87d-b1f301c15819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:34 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Volume 1ae86455-cbab-4eb7-b83e-36a79e72ce59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59', 'volume_size': 1}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-783726480',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ae86455-cbab-4eb7-b83e-36a79e72ce59,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='acfdeb7846f3477b95b319a5ffff037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:35Z,use_quota=True,user_id='4c82a4cc53e84a7083d6f1d16cdd9c22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Creating volume 1ae86455-cbab-4eb7-b83e-36a79e72ce59 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:34 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:34 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59 1073741824
Apr 22 02:42:34 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Acquiring lock "cinder-ee47cd62-9e08-41de-8a21-f81f3c284f84-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Lock "cinder-ee47cd62-9e08-41de-8a21-f81f3c284f84-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Acquiring lock "cinder-quobyte-ee47cd62-9e08-41de-8a21-f81f3c284f84" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Lock "cinder-quobyte-ee47cd62-9e08-41de-8a21-f81f3c284f84" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d540321-a657-4b3f-b157-c759a8df08fc]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:35 devstack sudo[89216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84
Apr 22 02:42:35 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:35 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59 1073741824" returned: 0 in 0.514s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:35 devstack sudo[89218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59
Apr 22 02:42:35 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:35 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84" returned: 0 in 0.476s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:35 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84
Apr 22 02:42:35 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:35 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59" returned: 0 in 0.400s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037563cd-fb40-41b3-a87d-b1f301c15819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dda878-d065-432f-9087-1162d53be9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:35 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Volume volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59 (1ae86455-cbab-4eb7-b83e-36a79e72ce59): created successfully
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71dda878-d065-432f-9087-1162d53be9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Flow 'volume_create_manager' (0ca3d423-6c86-4ced-bc08-832017a768d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ff096fb3-d4f0-4016-8c62-d0c26698ef97 tempest-VolumesListTestJSON-462294457 None] Created volume successfully.
Apr 22 02:42:36 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ee47cd62-9e08-41de-8a21-f81f3c284f84" returned: 0 in 0.458s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Lock "cinder-quobyte-ee47cd62-9e08-41de-8a21-f81f3c284f84" released by "delete_volume" :: held 0.960s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Created reservations ['4cd20d8e-e52e-4ef4-a056-3da5fda2e75d', 'e1d947b3-c12c-42d3-93a4-1f9783b45697', '797a9983-3182-4cca-808a-e02f8c84863e', '2a5551b9-8f1c-4328-b658-3a83c2d88f4c'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:36 devstack sudo[89227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:36 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:36 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.493s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:36 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Deleted volume successfully.
Apr 22 02:42:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d1ffdfe6-81eb-4521-a904-d05e428f7c9c tempest-AbsoluteLimitsTests-1732561624 None] Lock "cinder-ee47cd62-9e08-41de-8a21-f81f3c284f84-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Acquiring lock "cinder-1ae86455-cbab-4eb7-b83e-36a79e72ce59-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Lock "cinder-1ae86455-cbab-4eb7-b83e-36a79e72ce59-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Acquiring lock "cinder-quobyte-1ae86455-cbab-4eb7-b83e-36a79e72ce59" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Lock "cinder-quobyte-1ae86455-cbab-4eb7-b83e-36a79e72ce59" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:38 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a31715a-b0a3-4725-88f5-353bff415952]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:38 devstack sudo[89232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59
Apr 22 02:42:38 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:39 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59" returned: 0 in 0.580s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:39 devstack sudo[89238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59
Apr 22 02:42:39 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Flow 'volume_create_manager' (359c9a25-f910-4a82-b43a-90733973026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98277a9c-a04b-4d79-8122-ee5f7af8ca54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98277a9c-a04b-4d79-8122-ee5f7af8ca54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1538135186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42dcf346-5204-44e7-a2ba-7ce256657b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda8c6a879cc4a78b003f1161949a77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:40Z,use_quota=True,user_id='473b817f6a714674bb7baa29f0d13977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edabbb2f-7feb-4b54-bdc6-8e55f62f4810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edabbb2f-7feb-4b54-bdc6-8e55f62f4810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df0f25d-f128-4b2f-b330-0cd69062d06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df0f25d-f128-4b2f-b330-0cd69062d06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42dcf346-5204-44e7-a2ba-7ce256657b3b', 'volume_name': 'volume-42dcf346-5204-44e7-a2ba-7ce256657b3b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3474b19-ec59-44f4-8658-ff5f6dd2c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3474b19-ec59-44f4-8658-ff5f6dd2c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a2137c-3b80-46fc-86cc-8f80f6a71199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:39 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Volume 42dcf346-5204-44e7-a2ba-7ce256657b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42dcf346-5204-44e7-a2ba-7ce256657b3b', 'volume_size': 1}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1538135186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42dcf346-5204-44e7-a2ba-7ce256657b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda8c6a879cc4a78b003f1161949a77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:40Z,use_quota=True,user_id='473b817f6a714674bb7baa29f0d13977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Creating volume 42dcf346-5204-44e7-a2ba-7ce256657b3b {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:39 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:39 devstack sudo[89240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b 1073741824
Apr 22 02:42:39 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:39 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1ae86455-cbab-4eb7-b83e-36a79e72ce59" returned: 0 in 0.452s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Lock "cinder-quobyte-1ae86455-cbab-4eb7-b83e-36a79e72ce59" released by "delete_volume" :: held 1.063s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Created reservations ['696a1309-61bd-4644-9653-08f6ac7debae', '226b4fec-b36d-4466-b693-b6985161ecdc', '3ba31d5c-7bb6-4387-8a2d-ca68685efbe0', '6026aa8b-cb80-47ae-bd6c-b861460652bb'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:40 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:40 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:40 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b 1073741824" returned: 0 in 0.531s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:40 devstack sudo[89249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b
Apr 22 02:42:40 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:40 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:40 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Deleted volume successfully.
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cf55a952-ce33-4acd-a88b-b7876f644f96 tempest-VolumesListTestJSON-462294457 None] Lock "cinder-1ae86455-cbab-4eb7-b83e-36a79e72ce59-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:40 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a2137c-3b80-46fc-86cc-8f80f6a71199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42dcf346-5204-44e7-a2ba-7ce256657b3b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c22b264-3930-4bf3-9196-be965f9724b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:40 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Volume volume-42dcf346-5204-44e7-a2ba-7ce256657b3b (42dcf346-5204-44e7-a2ba-7ce256657b3b): created successfully
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c22b264-3930-4bf3-9196-be965f9724b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Flow 'volume_create_manager' (359c9a25-f910-4a82-b43a-90733973026c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:40 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-7b16eaa1-03dd-44a6-b30a-b725d0ad15b4 tempest-VolumesTransfersV355Test-1678871769 None] Created volume successfully.
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Acquiring lock "cinder-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Lock "cinder-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Acquiring lock "cinder-quobyte-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Lock "cinder-quobyte-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2674f7-b076-4a12-9ab8-62b7d0acc743]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:41 devstack sudo[89252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be
Apr 22 02:42:41 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Acquiring lock "cinder-7b7e7aca-7643-4686-852f-9b9ec1727227-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Lock "cinder-7b7e7aca-7643-4686-852f-9b9ec1727227-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Acquiring lock "cinder-quobyte-7b7e7aca-7643-4686-852f-9b9ec1727227" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Lock "cinder-quobyte-7b7e7aca-7643-4686-852f-9b9ec1727227" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b73448-0b83-4aa7-bd99-9300d525da0b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:41 devstack sudo[89256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227
Apr 22 02:42:41 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:41 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be" returned: 0 in 0.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:41 devstack sudo[89260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be
Apr 22 02:42:41 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:42 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227" returned: 0 in 0.483s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:42 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be" returned: 0 in 0.412s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:42 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227
Apr 22 02:42:42 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Lock "cinder-quobyte-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be" released by "delete_volume" :: held 0.959s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Created reservations ['c7533ed1-a5a5-4ab4-a40e-eed64c33331a', 'b1d36d2c-9913-4105-a93c-22924075994f', '421f8a5f-1fbf-46c1-8e49-99fc18b700f9', 'f3ccc078-4603-430a-87c8-c09ed6f6dbe8'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:42 devstack sudo[89268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:42 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:42 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-55579def-8bf7-4532-be7f-b718fd270a4e tempest-VolumesTransfersV355Test-2068238341 None] Transfer volume completed successfully.
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Acquiring lock "cinder-06872943-b94d-44e8-9266-03c087f9bd54-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Lock "cinder-06872943-b94d-44e8-9266-03c087f9bd54-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Acquiring lock "cinder-quobyte-06872943-b94d-44e8-9266-03c087f9bd54" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Lock "cinder-quobyte-06872943-b94d-44e8-9266-03c087f9bd54" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d0333-e5ba-46ff-85e6-f09399487c7b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:42 devstack sudo[89270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54
Apr 22 02:42:42 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:42 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7b7e7aca-7643-4686-852f-9b9ec1727227" returned: 0 in 0.441s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Lock "cinder-quobyte-7b7e7aca-7643-4686-852f-9b9ec1727227" released by "delete_volume" :: held 0.949s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Created reservations ['93fad4b0-7c53-43c1-b5d0-e120f6f4cf20', '32d4b803-78b3-4bf4-8e56-9b7f2c4cfeb0', '803c2cc5-0e9d-4d97-8a3a-9c9ad8c6836c', 'd5439163-952f-4f52-b6f7-bc80cc40f8a6'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:42 devstack sudo[89274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:42 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:42 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.455s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:42 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Deleted volume successfully.
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a1d47825-5691-4a5c-ba51-b4a9f04546aa tempest-VolumesListTestJSON-462294457 None] Lock "cinder-b7f4f6cb-f042-4ae0-a5ea-9ed5143cd8be-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:42 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54" returned: 0 in 0.493s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:42 devstack sudo[89279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54
Apr 22 02:42:42 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:43 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.478s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:43 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Deleted volume successfully.
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c1fa0948-2953-433b-8dc8-cadacd057646 tempest-VolumesNegativeTest-1968731111 None] Lock "cinder-7b7e7aca-7643-4686-852f-9b9ec1727227-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Acquiring lock "cinder-42dcf346-5204-44e7-a2ba-7ce256657b3b-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Lock "cinder-42dcf346-5204-44e7-a2ba-7ce256657b3b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Acquiring lock "cinder-quobyte-42dcf346-5204-44e7-a2ba-7ce256657b3b" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Lock "cinder-quobyte-42dcf346-5204-44e7-a2ba-7ce256657b3b" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafc98d4-f376-4e1b-97df-b8eec15ebc8a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:43 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-06872943-b94d-44e8-9266-03c087f9bd54" returned: 0 in 0.512s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Lock "cinder-quobyte-06872943-b94d-44e8-9266-03c087f9bd54" released by "delete_volume" :: held 1.028s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:43 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b
Apr 22 02:42:43 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Created reservations ['500db0b7-0b27-4493-ad2d-1857d61842c1', '6a03b796-7731-4c75-b848-b2d46d77dca7', '7a82ec5e-8fe7-4aae-bb5f-db8dfca202ec', 'cef4ae4f-191b-4f64-b3ec-236b3d031ded'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:43 devstack sudo[89285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:43 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:43 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b" returned: 0 in 0.558s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:43 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b
Apr 22 02:42:43 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:43 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.474s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:43 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Deleted volume successfully.
Apr 22 02:42:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2e4258fa-a0c2-4121-bed8-9cde2f54fa0a tempest-VolumesListTestJSON-462294457 None] Lock "cinder-06872943-b94d-44e8-9266-03c087f9bd54-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (e5d9b612-75ec-467d-bbbd-1656d45ef8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9705ef-1d49-4852-9748-6908bf2ff5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9705ef-1d49-4852-9748-6908bf2ff5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173799286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f01cae1-8f31-44ca-831b-28429db362c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:44Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3013cf22-40e9-47fa-abd7-fdd54f036f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3013cf22-40e9-47fa-abd7-fdd54f036f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa45e42-422a-4935-8b13-35a2cc78e47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa45e42-422a-4935-8b13-35a2cc78e47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f01cae1-8f31-44ca-831b-28429db362c2', 'volume_name': 'volume-7f01cae1-8f31-44ca-831b-28429db362c2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa3b44e-6a5e-45c1-a08c-b926687c9934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa3b44e-6a5e-45c1-a08c-b926687c9934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12080ac9-b619-4bc0-b8ab-8a281d36f061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:44 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume 7f01cae1-8f31-44ca-831b-28429db362c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f01cae1-8f31-44ca-831b-28429db362c2', 'volume_size': 1}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173799286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f01cae1-8f31-44ca-831b-28429db362c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:44Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Creating volume 7f01cae1-8f31-44ca-831b-28429db362c2 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:44 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:44 devstack sudo[89294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2 1073741824
Apr 22 02:42:44 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:44 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42dcf346-5204-44e7-a2ba-7ce256657b3b" returned: 0 in 0.439s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Lock "cinder-quobyte-42dcf346-5204-44e7-a2ba-7ce256657b3b" released by "delete_volume" :: held 1.024s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Created reservations ['f8cb3cc5-166d-4a29-83ab-f05f99cf9d09', 'a6e159f6-f123-45fa-b9d4-f7a65bb1b890', 'c32434bf-346c-457a-a145-d1dc3f524f07', '66317a75-4c06-4d96-8d66-0b7dfcbfe43a'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:44 devstack sudo[89296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:44 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:44 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2 1073741824" returned: 0 in 0.556s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:44 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:44 devstack sudo[89302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:44 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:44 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Deleted volume successfully.
Apr 22 02:42:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-58d8f32d-96f1-46a6-891e-8c42ec20d33e tempest-VolumesTransfersV355Test-1034901221 None] Lock "cinder-42dcf346-5204-44e7-a2ba-7ce256657b3b-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:45 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2" returned: 0 in 0.445s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12080ac9-b619-4bc0-b8ab-8a281d36f061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f01cae1-8f31-44ca-831b-28429db362c2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce400a2-a679-40d4-a1dc-0e67b670ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:45 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume volume-7f01cae1-8f31-44ca-831b-28429db362c2 (7f01cae1-8f31-44ca-831b-28429db362c2): created successfully
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce400a2-a679-40d4-a1dc-0e67b670ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (e5d9b612-75ec-467d-bbbd-1656d45ef8fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:45 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6b99d17d-92d3-4323-820b-0c47ea3d2566 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created volume successfully.
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Flow 'volume_create_manager' (05968f73-49fc-44ad-abc9-64cbd2a16dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df93ebd9-ef34-40f2-92c9-ee47298f57db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df93ebd9-ef34-40f2-92c9-ee47298f57db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1112749823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f90ffe-ed9e-4928-9c9d-b3b519a595e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda8c6a879cc4a78b003f1161949a77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:46Z,use_quota=True,user_id='473b817f6a714674bb7baa29f0d13977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc00531-a7e0-4921-837a-6664b7deaa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc00531-a7e0-4921-837a-6664b7deaa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e3ea56-ba61-458e-bb16-2db7fbe4e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e3ea56-ba61-458e-bb16-2db7fbe4e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f90ffe-ed9e-4928-9c9d-b3b519a595e2', 'volume_name': 'volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523b3ee8-bafa-4108-a9c1-5051bd7c5a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523b3ee8-bafa-4108-a9c1-5051bd7c5a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed6a62f-a636-4e51-a1a2-482d1982ed75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:45 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Volume d7f90ffe-ed9e-4928-9c9d-b3b519a595e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2', 'volume_size': 1}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1112749823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f90ffe-ed9e-4928-9c9d-b3b519a595e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda8c6a879cc4a78b003f1161949a77f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:46Z,use_quota=True,user_id='473b817f6a714674bb7baa29f0d13977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Creating volume d7f90ffe-ed9e-4928-9c9d-b3b519a595e2 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:45 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:45 devstack sudo[89305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2 1073741824
Apr 22 02:42:45 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:46 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2 1073741824" returned: 0 in 0.548s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:46 devstack sudo[89310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2
Apr 22 02:42:46 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:46 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2" returned: 0 in 0.494s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.348s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Creating offline snapshot a248fe6d-ac73-434d-a80e-cbe9f3c00568 of volume 7f01cae1-8f31-44ca-831b-28429db362c2 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed6a62f-a636-4e51-a1a2-482d1982ed75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a68b01-75ff-4b1a-b12e-e4ca7d8aa121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f7de18-7488-49c3-b39c-d27d0a0f2a3d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:46 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Volume volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2 (d7f90ffe-ed9e-4928-9c9d-b3b519a595e2): created successfully
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a68b01-75ff-4b1a-b12e-e4ca7d8aa121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Flow 'volume_create_manager' (05968f73-49fc-44ad-abc9-64cbd2a16dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:46 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d14e750d-e5b7-4d94-9c56-186999a2c2bc tempest-VolumesTransfersV355Test-1678871769 None] Created volume successfully.
Apr 22 02:42:46 devstack sudo[89313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2
Apr 22 02:42:46 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:47 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2" returned: 0 in 0.478s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:47 devstack sudo[89318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 1G
Apr 22 02:42:47 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:47 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 1G" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f01cae1-8f31-44ca-831b-28429db362c2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:47 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f01cae1-8f31-44ca-831b-28429db362c2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568
Apr 22 02:42:47 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Acquiring lock "cinder-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:47 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Lock "cinder-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Acquiring lock "cinder-quobyte-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Lock "cinder-quobyte-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e734e22-3685-4ebe-bdee-13eb20521ebb]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:48 devstack sudo[89325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2
Apr 22 02:42:48 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:48 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f01cae1-8f31-44ca-831b-28429db362c2 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:48 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 is being set with open permissions: ugo+rw
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:48 devstack sudo[89330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568
Apr 22 02:42:48 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:48 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2" returned: 0 in 0.519s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:48 devstack sudo[89336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2
Apr 22 02:42:48 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:48 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568" returned: 0 in 0.421s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:48 devstack sudo[89338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.info
Apr 22 02:42:48 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:49 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.info" returned: 0 in 0.482s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:49 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.info is being set with open permissions: ugo+rw
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:49 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2" returned: 0 in 0.558s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:49 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.info
Apr 22 02:42:49 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Lock "cinder-quobyte-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2" released by "delete_volume" :: held 1.118s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Created reservations ['4932677d-067a-4bad-8783-9e81b6035927', 'd155c38a-b744-4097-98f0-af7ad50a27e3', '9f780831-b95b-479a-b02d-a87a1fb02582', '8ea69239-9bc7-46a3-ab9c-7e1bafd654eb'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:49 devstack sudo[89344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:49 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:49 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.info" returned: 0 in 0.465s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.888s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:49 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-1957de63-3f86-4390-a2b7-e5d1b8bca56e tempest-CreateVolumesFromSnapshotTest-2056692529 None] Create snapshot completed successfully
Apr 22 02:42:49 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.460s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:49 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Deleted volume successfully.
Apr 22 02:42:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-45219376-338b-4fd8-9305-67e1a258ce60 tempest-VolumesTransfersV355Test-1034901221 None] Lock "cinder-d7f90ffe-ed9e-4928-9c9d-b3b519a595e2-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (0282baee-f2eb-4005-8213-8397f6207dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c90bdb-be66-4b64-a740-2d8f6f58eaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c90bdb-be66-4b64-a740-2d8f6f58eaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1544905034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1512d005-a2f7-44a4-bd6e-a2189cc6b75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:51Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5436ed54-903d-4661-a0af-85febb8a0e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5436ed54-903d-4661-a0af-85febb8a0e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1124c8c0-ce28-4947-88d3-2358c32d30d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1124c8c0-ce28-4947-88d3-2358c32d30d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1512d005-a2f7-44a4-bd6e-a2189cc6b75a', 'volume_name': 'volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9491581d-d32f-4356-be56-2048a9d89dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9491581d-d32f-4356-be56-2048a9d89dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f241208-0b48-4a5b-92a8-44dc19fc60a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:50 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume 1512d005-a2f7-44a4-bd6e-a2189cc6b75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a', 'volume_size': 1}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1544905034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1512d005-a2f7-44a4-bd6e-a2189cc6b75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:51Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Creating volume 1512d005-a2f7-44a4-bd6e-a2189cc6b75a {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:50 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:50 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a 1073741824
Apr 22 02:42:50 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (bb94a89a-5c56-4f75-88bc-59f9b7a6a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be968db5-ed49-4844-98e4-b689e0c4d45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be968db5-ed49-4844-98e4-b689e0c4d45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1983934537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75da85bf-5366-461b-aac8-31b81977a5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:51Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66adca21-b136-4b67-8cb7-ccb9019287ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66adca21-b136-4b67-8cb7-ccb9019287ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ac7311-c36a-42cc-9f39-ee314c776cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ac7311-c36a-42cc-9f39-ee314c776cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75da85bf-5366-461b-aac8-31b81977a5ea', 'volume_name': 'volume-75da85bf-5366-461b-aac8-31b81977a5ea', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b597007e-549f-4ab5-bdb6-d977e4fc42d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b597007e-549f-4ab5-bdb6-d977e4fc42d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ee320c-a66f-4159-8e4c-06d44ec01173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume 75da85bf-5366-461b-aac8-31b81977a5ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75da85bf-5366-461b-aac8-31b81977a5ea', 'volume_size': 1}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (16d03584-327e-40b1-8898-90ad3503db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ea082d-5276-4037-b4cf-16d2ed563aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ea082d-5276-4037-b4cf-16d2ed563aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213150609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2729982-d953-4e7f-af6c-9a182e715c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:51Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01137bbc-ebb2-4a11-ae59-f3ddecdb9a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01137bbc-ebb2-4a11-ae59-f3ddecdb9a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa8c7c1-4325-44b4-a55a-a6ee2a128569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa8c7c1-4325-44b4-a55a-a6ee2a128569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2729982-d953-4e7f-af6c-9a182e715c24', 'volume_name': 'volume-b2729982-d953-4e7f-af6c-9a182e715c24', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fc2394-336d-4cdc-8869-40d10d995c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fc2394-336d-4cdc-8869-40d10d995c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17983673-0337-4a39-a9f1-6534986a6059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume b2729982-d953-4e7f-af6c-9a182e715c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2729982-d953-4e7f-af6c-9a182e715c24', 'volume_size': 1}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (23da0529-f278-432b-b77c-0569bfa3a008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebe01cb-6825-4916-9e7e-ecc2fa8393c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ebe01cb-6825-4916-9e7e-ecc2fa8393c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212329561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bece9d9f-4a91-4f68-87ae-2ddb884f81c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:52Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78534303-157d-4bc9-82a6-b198b161a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78534303-157d-4bc9-82a6-b198b161a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41435076-99d5-4435-83df-c78f692ac844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41435076-99d5-4435-83df-c78f692ac844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bece9d9f-4a91-4f68-87ae-2ddb884f81c7', 'volume_name': 'volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca284cb0-d5d1-4e0c-8717-a566e5dae095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca284cb0-d5d1-4e0c-8717-a566e5dae095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b28beac-c876-46b0-9283-7d1d228ee643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:51 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume bece9d9f-4a91-4f68-87ae-2ddb884f81c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7', 'volume_size': 1}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:51 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a 1073741824" returned: 0 in 0.935s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:51 devstack sudo[89355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a
Apr 22 02:42:51 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (a6757430-017e-4288-b8f9-3885c6e423c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fc1f91-11da-4646-8dbf-9a3845fe8fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15fc1f91-11da-4646-8dbf-9a3845fe8fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222222598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa87490-ba7d-49bd-baca-1b45f6586d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:52Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7743f0b6-08e6-493b-8075-7f6563470a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7743f0b6-08e6-493b-8075-7f6563470a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654e365a-ee3c-49f1-af78-6898c7adbacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (654e365a-ee3c-49f1-af78-6898c7adbacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa87490-ba7d-49bd-baca-1b45f6586d52', 'volume_name': 'volume-afa87490-ba7d-49bd-baca-1b45f6586d52', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8081376b-847b-42ef-a448-dffd41374e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8081376b-847b-42ef-a448-dffd41374e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0385d5f-429a-43ec-aad7-75d8aa6a2cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume afa87490-ba7d-49bd-baca-1b45f6586d52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa87490-ba7d-49bd-baca-1b45f6586d52', 'volume_size': 1}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:52 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a" returned: 0 in 0.563s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.224s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1983934537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75da85bf-5366-461b-aac8-31b81977a5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:51Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Creating volume 75da85bf-5366-461b-aac8-31b81977a5ea {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:52 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f241208-0b48-4a5b-92a8-44dc19fc60a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:52 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea 1073741824
Apr 22 02:42:52 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d60f22d-a57a-45b3-8d6c-eaa820bae88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a (1512d005-a2f7-44a4-bd6e-a2189cc6b75a): created successfully
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d60f22d-a57a-45b3-8d6c-eaa820bae88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (0282baee-f2eb-4005-8213-8397f6207dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5ac1c3b6-4579-4c5c-a462-a033c579a563 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created volume successfully.
Apr 22 02:42:53 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea 1073741824" returned: 0 in 0.554s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:53 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea
Apr 22 02:42:53 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:53 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea" returned: 0 in 0.520s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1213150609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2729982-d953-4e7f-af6c-9a182e715c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:51Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Creating volume b2729982-d953-4e7f-af6c-9a182e715c24 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:53 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ee320c-a66f-4159-8e4c-06d44ec01173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75da85bf-5366-461b-aac8-31b81977a5ea', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:53 devstack sudo[89367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24 1073741824
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d3c45-feee-4057-84e6-f4254e1df089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:53 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:53 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume volume-75da85bf-5366-461b-aac8-31b81977a5ea (75da85bf-5366-461b-aac8-31b81977a5ea): created successfully
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d3c45-feee-4057-84e6-f4254e1df089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (bb94a89a-5c56-4f75-88bc-59f9b7a6a398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:53 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5f2eb701-5bd6-402d-ab19-57f05a06e810 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created volume successfully.
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Flow 'volume_create_manager' (54b49378-3112-4be9-b2ac-7f7fc083ea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1204e69b-6a9f-4bf9-9849-1e6acd74ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1204e69b-6a9f-4bf9-9849-1e6acd74ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1441160418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91db411f-01a0-4e6b-8cdb-c12743e641c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c2f4361e2b4cf38d553d392dbd6efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:54Z,use_quota=True,user_id='3f8db6d8e77140ef8323e7bd2603611d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea505a8e-6a14-4e45-99ef-653c9af3dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea505a8e-6a14-4e45-99ef-653c9af3dd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabea3bf-94da-4047-84b6-4618bd3d9b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabea3bf-94da-4047-84b6-4618bd3d9b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91db411f-01a0-4e6b-8cdb-c12743e641c1', 'volume_name': 'volume-91db411f-01a0-4e6b-8cdb-c12743e641c1', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2152788c-4caf-4da0-a5b5-727fb9180055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2152788c-4caf-4da0-a5b5-727fb9180055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a831d9-486f-47e0-808b-f7febd08a52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:54 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Volume 91db411f-01a0-4e6b-8cdb-c12743e641c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91db411f-01a0-4e6b-8cdb-c12743e641c1', 'volume_size': 1}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:54 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24 1073741824" returned: 0 in 0.524s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:54 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24
Apr 22 02:42:54 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (ca26858c-8b2e-4792-a511-7cf2b1d10a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ef17d9-ae57-40cb-8d7b-93795007cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ef17d9-ae57-40cb-8d7b-93795007cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1576346021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568053af-0281-4659-896a-7a36dfb090a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5e1d893374fde9bc9182758b7e752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:54Z,use_quota=True,user_id='1e56a88b820b406b88b48f70aaec7c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b8fa51-ac72-48b3-b537-352ff997c61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b8fa51-ac72-48b3-b537-352ff997c61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0d5bf1-17c2-4c88-9b13-52f88add44fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0d5bf1-17c2-4c88-9b13-52f88add44fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568053af-0281-4659-896a-7a36dfb090a3', 'volume_name': 'volume-568053af-0281-4659-896a-7a36dfb090a3', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9b9235-6246-4ea1-a139-b4e692da424b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9b9235-6246-4ea1-a139-b4e692da424b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ef7a69-cced-4494-9aa1-2cea5f1ed20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:54 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Volume 568053af-0281-4659-896a-7a36dfb090a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568053af-0281-4659-896a-7a36dfb090a3', 'volume_size': 1}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:54 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.770s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212329561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bece9d9f-4a91-4f68-87ae-2ddb884f81c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:52Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Creating volume bece9d9f-4a91-4f68-87ae-2ddb884f81c7 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:54 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17983673-0337-4a39-a9f1-6534986a6059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2729982-d953-4e7f-af6c-9a182e715c24', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:54 devstack sudo[89375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7 1073741824
Apr 22 02:42:54 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f34f75b-508c-4cfe-8f14-89c580aeeca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:54 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume volume-b2729982-d953-4e7f-af6c-9a182e715c24 (b2729982-d953-4e7f-af6c-9a182e715c24): created successfully
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f34f75b-508c-4cfe-8f14-89c580aeeca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (16d03584-327e-40b1-8898-90ad3503db03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6dcc3cff-e327-4e69-9931-ee8cf35521e1 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created volume successfully.
Apr 22 02:42:55 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7 1073741824" returned: 0 in 0.498s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:55 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7
Apr 22 02:42:55 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:55 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7" returned: 0 in 0.411s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.388s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1222222598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa87490-ba7d-49bd-baca-1b45f6586d52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51220ee092694887add7a6c2ac832817',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:52Z,use_quota=True,user_id='9bd3763bfd4043a4903b6fa53805acd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Creating volume afa87490-ba7d-49bd-baca-1b45f6586d52 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:55 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b28beac-c876-46b0-9283-7d1d228ee643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb410f0-781c-41eb-8db8-c3b68548e32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:55 devstack sudo[89383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52 1073741824
Apr 22 02:42:55 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:55 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7 (bece9d9f-4a91-4f68-87ae-2ddb884f81c7): created successfully
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb410f0-781c-41eb-8db8-c3b68548e32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (23da0529-f278-432b-b77c-0569bfa3a008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:55 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-45fd268d-f731-488b-836e-eb1cf8620049 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created volume successfully.
Apr 22 02:42:55 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52 1073741824" returned: 0 in 0.468s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:55 devstack sudo[89388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52
Apr 22 02:42:55 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:56 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52" returned: 0 in 0.422s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.388s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1441160418',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91db411f-01a0-4e6b-8cdb-c12743e641c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c2f4361e2b4cf38d553d392dbd6efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:54Z,use_quota=True,user_id='3f8db6d8e77140ef8323e7bd2603611d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Creating volume 91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:56 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0385d5f-429a-43ec-aad7-75d8aa6a2cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa87490-ba7d-49bd-baca-1b45f6586d52', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566999ee-ad07-4a86-8387-9990542f5c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:56 devstack sudo[89391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 1073741824
Apr 22 02:42:56 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:56 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Volume volume-afa87490-ba7d-49bd-baca-1b45f6586d52 (afa87490-ba7d-49bd-baca-1b45f6586d52): created successfully
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566999ee-ad07-4a86-8387-9990542f5c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Flow 'volume_create_manager' (a6757430-017e-4288-b8f9-3885c6e423c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:56 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-094fd38c-be27-4e52-a665-60bf80d6dc3b tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created volume successfully.
Apr 22 02:42:56 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 1073741824" returned: 0 in 0.467s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:56 devstack sudo[89396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1
Apr 22 02:42:56 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:57 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1" returned: 0 in 0.423s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.094s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1576346021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568053af-0281-4659-896a-7a36dfb090a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5e1d893374fde9bc9182758b7e752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:42:54Z,use_quota=True,user_id='1e56a88b820b406b88b48f70aaec7c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Creating volume 568053af-0281-4659-896a-7a36dfb090a3 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:42:57 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a831d9-486f-47e0-808b-f7febd08a52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91db411f-01a0-4e6b-8cdb-c12743e641c1', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a2e10d-3d7d-40ef-9ad7-95c8c7c2c989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:57 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3 1073741824
Apr 22 02:42:57 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=170,cinder:INSERT=57,cinder:UPDATE=202,cinder:DELETE=17 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:42:57 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Volume volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 (91db411f-01a0-4e6b-8cdb-c12743e641c1): created successfully
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72a2e10d-3d7d-40ef-9ad7-95c8c7c2c989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Flow 'volume_create_manager' (54b49378-3112-4be9-b2ac-7f7fc083ea18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-7622623c-e230-4c5a-a0b1-847372c5d95d tempest-VolumesSnapshotListTestJSON-1274184030 None] Created volume successfully.
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-afa87490-ba7d-49bd-baca-1b45f6586d52-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-afa87490-ba7d-49bd-baca-1b45f6586d52-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-quobyte-afa87490-ba7d-49bd-baca-1b45f6586d52" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-afa87490-ba7d-49bd-baca-1b45f6586d52" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fffb4e5-4ec8-41de-bc30-a4cc8d2bacfb]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:57 devstack sudo[89401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52
Apr 22 02:42:57 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:57 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3 1073741824" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:57 devstack sudo[89406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3
Apr 22 02:42:57 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:58 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52" returned: 0 in 0.476s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:58 devstack sudo[89411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52
Apr 22 02:42:58 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:58 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3" returned: 0 in 0.421s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ef7a69-cced-4494-9aa1-2cea5f1ed20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568053af-0281-4659-896a-7a36dfb090a3', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48127a3-a61e-4947-9b7f-e91bbf8d25f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Creating offline snapshot da743a26-cb21-489d-83df-d21ce38b0d43 of volume 91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:42:58 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Volume volume-568053af-0281-4659-896a-7a36dfb090a3 (568053af-0281-4659-896a-7a36dfb090a3): created successfully
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48127a3-a61e-4947-9b7f-e91bbf8d25f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (ca26858c-8b2e-4792-a511-7cf2b1d10a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4464ed3-7071-40b5-b7f4-65540a9a3cfe]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0573eafa-e277-499d-b47b-b45a3cadfcd3 tempest-VolumesSnapshotTestJSON-963446238 None] Created volume successfully.
Apr 22 02:42:58 devstack sudo[89414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1
Apr 22 02:42:58 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:58 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-afa87490-ba7d-49bd-baca-1b45f6586d52" returned: 0 in 0.439s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-afa87490-ba7d-49bd-baca-1b45f6586d52" released by "delete_volume" :: held 0.956s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created reservations ['df106e61-fd12-4d95-bc70-fe64074fafde', '96713005-adba-43c1-8f76-3fd6489313a0', '19072899-544a-45d1-8b39-05e556a025e9', 'a74284d7-61f4-423e-bb97-017ab920e62f'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:58 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:58 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-bece9d9f-4a91-4f68-87ae-2ddb884f81c7-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-bece9d9f-4a91-4f68-87ae-2ddb884f81c7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-quobyte-bece9d9f-4a91-4f68-87ae-2ddb884f81c7" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-bece9d9f-4a91-4f68-87ae-2ddb884f81c7" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8311ce-0cda-44eb-8784-23a41ab2d5f6]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:58 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7
Apr 22 02:42:58 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:58 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:58 devstack sudo[89424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 1G
Apr 22 02:42:58 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:59 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:42:59 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Deleted volume successfully.
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7422f68-b35a-444b-9b91-2fd2776e8270 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-afa87490-ba7d-49bd-baca-1b45f6586d52-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:59 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:59 devstack sudo[89433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7
Apr 22 02:42:59 devstack sudo[89433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:59 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 1G" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:59 devstack sudo[89435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43
Apr 22 02:42:59 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:59 devstack sudo[89433]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-bece9d9f-4a91-4f68-87ae-2ddb884f81c7" returned: 0 in 0.460s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-bece9d9f-4a91-4f68-87ae-2ddb884f81c7" released by "delete_volume" :: held 0.980s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created reservations ['ef7f980b-17c1-4784-bdb0-a3e4cb89679e', '13abcd35-c9c5-41f3-9be8-8527bc1712db', 'f69dce43-f726-4577-947a-70f28bf78d51', '0397007e-a097-4504-bace-68ee10908d61'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:59 devstack sudo[89441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:42:59 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-b2729982-d953-4e7f-af6c-9a182e715c24-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-b2729982-d953-4e7f-af6c-9a182e715c24-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:59 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43" returned: 0 in 0.488s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:42:59 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 is being set with open permissions: ugo+rw
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:59 devstack sudo[89443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43
Apr 22 02:42:59 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-quobyte-b2729982-d953-4e7f-af6c-9a182e715c24" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-b2729982-d953-4e7f-af6c-9a182e715c24" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd34401-9873-4e35-a481-d5b2c2e12b76]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:42:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:42:59 devstack sudo[89445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24
Apr 22 02:42:59 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:00 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.436s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:00 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Deleted volume successfully.
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bad51766-1132-4737-b493-82d9a9211c24 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-bece9d9f-4a91-4f68-87ae-2ddb884f81c7-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:00 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43" returned: 0 in 0.401s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:00 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.info
Apr 22 02:43:00 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:00 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24" returned: 0 in 0.482s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:00 devstack sudo[89454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24
Apr 22 02:43:00 devstack sudo[89454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:00 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.info" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:00 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.info is being set with open permissions: ugo+rw
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:00 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.info
Apr 22 02:43:00 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:00 devstack sudo[89454]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b2729982-d953-4e7f-af6c-9a182e715c24" returned: 0 in 0.405s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-b2729982-d953-4e7f-af6c-9a182e715c24" released by "delete_volume" :: held 0.907s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created reservations ['a7157104-e5bf-414b-a3c5-d7d71745fb74', '22221ec4-d109-4b18-a1b4-db2194e2c2a4', 'e2114c2e-1e79-43b2-8cd6-68d3c2744705', '26f40bc2-f0bb-4262-b395-1dd304761f47'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:00 devstack sudo[89460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:00 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-75da85bf-5366-461b-aac8-31b81977a5ea-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-75da85bf-5366-461b-aac8-31b81977a5ea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-quobyte-75da85bf-5366-461b-aac8-31b81977a5ea" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-75da85bf-5366-461b-aac8-31b81977a5ea" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14cfff2-0f33-4b00-8da8-7518939e1492]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:01 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea
Apr 22 02:43:01 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:01 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.info" returned: 0 in 0.433s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.812s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.440s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Creating offline snapshot 0f64a185-8aae-4eb2-8b48-7207fbae3b1c of volume 568053af-0281-4659-896a-7a36dfb090a3 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:43:01 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-16f15392-756f-4d30-b458-10a88de01e75 tempest-VolumesSnapshotListTestJSON-1274184030 None] Create snapshot completed successfully
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ee5fe9-0780-4b05-ae6f-476efa95d22e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:01 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3
Apr 22 02:43:01 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:01 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:01 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Deleted volume successfully.
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f158b59-26c2-449b-b5e3-571b0e974a35 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-b2729982-d953-4e7f-af6c-9a182e715c24-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:01 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea" returned: 0 in 0.514s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:01 devstack sudo[89471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea
Apr 22 02:43:01 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:01 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3" returned: 0 in 0.498s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:01 devstack sudo[89476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c 1G
Apr 22 02:43:01 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:01 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-75da85bf-5366-461b-aac8-31b81977a5ea" returned: 0 in 0.410s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-75da85bf-5366-461b-aac8-31b81977a5ea" released by "delete_volume" :: held 0.957s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created reservations ['b5f58625-b9c4-4887-b2d8-10efd908d079', '06ff2615-1e41-4d44-b29a-649838eb62dc', '1d8c727c-1d92-45bb-b5e2-5a3186f1f998', '1f706f91-d391-4899-a193-459f23035b11'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:01 devstack sudo[89483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:01 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-1512d005-a2f7-44a4-bd6e-a2189cc6b75a-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-1512d005-a2f7-44a4-bd6e-a2189cc6b75a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-quobyte-1512d005-a2f7-44a4-bd6e-a2189cc6b75a" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-1512d005-a2f7-44a4-bd6e-a2189cc6b75a" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f93a7b0-96b6-4798-bf8b-1edae1087548]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:02 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c 1G" returned: 0 in 0.521s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568053af-0281-4659-896a-7a36dfb090a3 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:02 devstack sudo[89486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568053af-0281-4659-896a-7a36dfb090a3 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c
Apr 22 02:43:02 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:02 devstack sudo[89485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a
Apr 22 02:43:02 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:02 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.436s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:02 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Deleted volume successfully.
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2039ad62-9035-4aa3-a3d6-ec6e9cb83f44 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-75da85bf-5366-461b-aac8-31b81977a5ea-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:02 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568053af-0281-4659-896a-7a36dfb090a3 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c" returned: 0 in 0.463s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:02 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c is being set with open permissions: ugo+rw
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:02 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a" returned: 0 in 0.521s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:02 devstack sudo[89496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c
Apr 22 02:43:02 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:02 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a
Apr 22 02:43:02 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:02 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c" returned: 0 in 0.397s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:03 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-1512d005-a2f7-44a4-bd6e-a2189cc6b75a" returned: 0 in 0.416s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-1512d005-a2f7-44a4-bd6e-a2189cc6b75a" released by "delete_volume" :: held 0.968s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:03 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.info
Apr 22 02:43:03 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created reservations ['b4f304ce-4636-47af-9a5b-87ec53a7942b', '51b97624-46a2-4ee2-9923-7fc5de378fb3', '926c170e-a72b-4974-b004-c1112e961e59', '204676ab-fba9-4ab4-bb02-40d25d62a7d6'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:03 devstack sudo[89504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:03 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-a248fe6d-ac73-434d-a80e-cbe9f3c00568-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-a248fe6d-ac73-434d-a80e-cbe9f3c00568-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-quobyte-7f01cae1-8f31-44ca-831b-28429db362c2" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-7f01cae1-8f31-44ca-831b-28429db362c2" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-quobyte-a248fe6d-ac73-434d-a80e-cbe9f3c00568" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-a248fe6d-ac73-434d-a80e-cbe9f3c00568" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Deleting offline snapshot a248fe6d-ac73-434d-a80e-cbe9f3c00568 of volume 7f01cae1-8f31-44ca-831b-28429db362c2 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] snapshot_file for this snap is: volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[040e6a70-22d5-48b0-9435-6c63c1d865c8]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:03 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568
Apr 22 02:43:03 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:03 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.info" returned: 0 in 0.447s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:03 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.info is being set with open permissions: ugo+rw
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:03 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.info
Apr 22 02:43:03 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:03 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.427s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Deleted volume successfully.
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a97a2d5b-7f3c-4579-8b5c-ba9bf59cba29 tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-1512d005-a2f7-44a4-bd6e-a2189cc6b75a-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:03 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f01cae1-8f31-44ca-831b-28429db362c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb48766f-c89c-41ed-8d83-da1bd1c2ee2b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:03 devstack sudo[89515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2
Apr 22 02:43:03 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:03 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.info" returned: 0 in 0.449s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.433s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Creating offline snapshot cb7722c3-aebb-4690-b0b1-899cc8dd6317 of volume 91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d344fc32-1968-44c3-93da-c7a2b77ef329]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-39a97c67-279a-4f16-8956-ab81fbba2ae9 tempest-VolumesSnapshotTestJSON-963446238 None] Create snapshot completed successfully
Apr 22 02:43:04 devstack sudo[89518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43
Apr 22 02:43:04 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:04 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2" returned: 0 in 0.486s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:04 devstack sudo[89523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568
Apr 22 02:43:04 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:04 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43" returned: 0 in 0.482s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db411f-01a0-4e6b-8cdb-c12743e641c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:04 devstack sudo[89528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 1G
Apr 22 02:43:04 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:04 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568" returned: 0 in 0.453s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:04 devstack sudo[89533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568
Apr 22 02:43:04 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:04 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 1G" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:04 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317
Apr 22 02:43:04 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-0f64a185-8aae-4eb2-8b48-7207fbae3b1c-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-0f64a185-8aae-4eb2-8b48-7207fbae3b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-568053af-0281-4659-896a-7a36dfb090a3" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-568053af-0281-4659-896a-7a36dfb090a3" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-0f64a185-8aae-4eb2-8b48-7207fbae3b1c" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-0f64a185-8aae-4eb2-8b48-7207fbae3b1c" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:05 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Deleting offline snapshot 0f64a185-8aae-4eb2-8b48-7207fbae3b1c of volume 568053af-0281-4659-896a-7a36dfb090a3 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] snapshot_file for this snap is: volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2.a248fe6d-ac73-434d-a80e-cbe9f3c00568" returned: 0 in 0.462s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e7e172-b06b-4298-84cd-8e0e7c921a16]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-a248fe6d-ac73-434d-a80e-cbe9f3c00568" released by "_delete_snapshot" :: held 1.971s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-7f01cae1-8f31-44ca-831b-28429db362c2" released by "delete_snapshot" :: held 1.982s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created reservations ['76aaebdc-95fa-4da1-95cb-c0ae4f0f248a', '89746a18-d4ab-40ee-88b4-4acd75a677c8', 'eb04d0ee-944b-47eb-9c13-33c0e0887421', '87e926da-3229-4784-8c4c-dc6b5544a053'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:05 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c
Apr 22 02:43:05 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:05 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Delete snapshot completed successfully.
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c0270033-897f-4f6b-8cc3-fa4b5dc8333c tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-a248fe6d-ac73-434d-a80e-cbe9f3c00568-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-7f01cae1-8f31-44ca-831b-28429db362c2-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-7f01cae1-8f31-44ca-831b-28429db362c2-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "cinder-quobyte-7f01cae1-8f31-44ca-831b-28429db362c2" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-7f01cae1-8f31-44ca-831b-28429db362c2" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[85086b0c-85d7-4953-a90e-2b3d16fc20e3]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:05 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317" returned: 0 in 0.452s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:05 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 is being set with open permissions: ugo+rw
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:05 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317
Apr 22 02:43:05 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:05 devstack sudo[89546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2
Apr 22 02:43:05 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:05 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c" returned: 0 in 0.533s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568053af-0281-4659-896a-7a36dfb090a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[41698986-d946-4c80-851a-70ead61071cb]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:05 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3
Apr 22 02:43:05 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:05 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:05 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2" returned: 0 in 0.485s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:05 devstack sudo[89559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2
Apr 22 02:43:05 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:05 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4cf2348a-72f6-41f7-bb9c-3028336f357b tempest-VolumesSnapshotListTestJSON-1274184030 None] Create snapshot completed successfully
Apr 22 02:43:06 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3" returned: 0 in 0.478s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:06 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c
Apr 22 02:43:06 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:06 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7f01cae1-8f31-44ca-831b-28429db362c2" returned: 0 in 0.416s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-quobyte-7f01cae1-8f31-44ca-831b-28429db362c2" released by "delete_volume" :: held 0.941s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Created reservations ['276a11ac-d8a8-424d-a4d5-7f81ca7a4977', 'aef867be-d947-4aae-893b-9577f1d781f8', 'b54c0eca-0422-44f4-870e-5bf235509d8b', 'a0704541-e7b7-4d34-a9ad-cd157601af44'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:06 devstack sudo[89567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:06 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:06 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c" returned: 0 in 0.515s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:06 devstack sudo[89573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c
Apr 22 02:43:06 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:06 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.449s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:06 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Deleted volume successfully.
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6fa88bdd-c547-4bec-8228-75e550b3416a tempest-CreateVolumesFromSnapshotTest-2056692529 None] Lock "cinder-7f01cae1-8f31-44ca-831b-28429db362c2-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Creating offline snapshot 1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 of volume 91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f92e0f4-ba84-4b92-9696-8e3b1d2b4347]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:06 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317
Apr 22 02:43:06 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:07 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3.0f64a185-8aae-4eb2-8b48-7207fbae3b1c" returned: 0 in 0.459s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-0f64a185-8aae-4eb2-8b48-7207fbae3b1c" released by "_delete_snapshot" :: held 2.051s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-568053af-0281-4659-896a-7a36dfb090a3" released by "delete_snapshot" :: held 2.064s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Created reservations ['658f3e40-cbf9-4e23-a09d-78302d31ce38', '58794bb7-e5d4-4f9c-ac9a-0d74e9b1a460', '6c642188-13e8-48bd-8512-58157ca95252', '1059116b-56a6-4b33-89d3-3cd515ce9f83'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Delete snapshot completed successfully.
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-71ba31e0-1b46-4a77-83bb-621c6ae00308 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-0f64a185-8aae-4eb2-8b48-7207fbae3b1c-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:07 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db411f-01a0-4e6b-8cdb-c12743e641c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:07 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 1G
Apr 22 02:43:07 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:07 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 1G" returned: 0 in 0.529s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:07 devstack sudo[89586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445
Apr 22 02:43:07 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Flow 'volume_create_manager' (e87def41-376a-44e4-82d7-9fb7520bc418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98ffd0e-ab3d-468a-93c0-e4a3c66025ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98ffd0e-ab3d-468a-93c0-e4a3c66025ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1606150562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cbe4a2-2eb4-4f20-84db-5dff03977c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41587c6a0e84f9d8751b63d1d593487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:08Z,use_quota=True,user_id='ad606b30e1044a1a841399b704a35d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe452c6-f3d7-4f1b-89c8-84fbc5c7e264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe452c6-f3d7-4f1b-89c8-84fbc5c7e264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34da403b-5092-433e-9d49-e4e06ace8715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34da403b-5092-433e-9d49-e4e06ace8715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05cbe4a2-2eb4-4f20-84db-5dff03977c57', 'volume_name': 'volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a89b27-9298-49f1-9ade-59190e674386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a89b27-9298-49f1-9ade-59190e674386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a526507-15b8-46b4-a76c-7547ca7e338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Volume 05cbe4a2-2eb4-4f20-84db-5dff03977c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57', 'volume_size': 1}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:08 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445" returned: 0 in 0.521s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:08 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 is being set with open permissions: ugo+rw
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:08 devstack sudo[89591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445
Apr 22 02:43:08 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (a2d1512c-ab4e-4f50-bfd9-378ec407e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c336d931-fdba-4a0c-9332-6dab1089ee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c336d931-fdba-4a0c-9332-6dab1089ee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1522840563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42aa9b49-2542-4feb-a2ad-175a193c468f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5e1d893374fde9bc9182758b7e752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:08Z,use_quota=True,user_id='1e56a88b820b406b88b48f70aaec7c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1736bc1-325f-4f89-ac4a-cf27c34ab382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1736bc1-325f-4f89-ac4a-cf27c34ab382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801462de-48ac-4940-85a9-c76dc416fce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801462de-48ac-4940-85a9-c76dc416fce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42aa9b49-2542-4feb-a2ad-175a193c468f', 'volume_name': 'volume-42aa9b49-2542-4feb-a2ad-175a193c468f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710981f7-3282-4c26-a8cc-b0c3d768b6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (710981f7-3282-4c26-a8cc-b0c3d768b6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abd779a-943f-4734-a8ed-6899a0ec25c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:08 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Volume 42aa9b49-2542-4feb-a2ad-175a193c468f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42aa9b49-2542-4feb-a2ad-175a193c468f', 'volume_size': 1}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:08 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445" returned: 0 in 0.405s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1606150562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05cbe4a2-2eb4-4f20-84db-5dff03977c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41587c6a0e84f9d8751b63d1d593487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:08Z,use_quota=True,user_id='ad606b30e1044a1a841399b704a35d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Creating volume 05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:08 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:08 devstack sudo[89594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 1073741824
Apr 22 02:43:08 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:08 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-1fc002cb-636b-4e1d-8f40-ca8d014d6ec8 tempest-VolumesSnapshotListTestJSON-1274184030 None] Create snapshot completed successfully
Apr 22 02:43:09 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 1073741824" returned: 0 in 0.469s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:09 devstack sudo[89599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57
Apr 22 02:43:09 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:09 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57" returned: 0 in 0.404s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.236s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1522840563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42aa9b49-2542-4feb-a2ad-175a193c468f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5e1d893374fde9bc9182758b7e752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:08Z,use_quota=True,user_id='1e56a88b820b406b88b48f70aaec7c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Creating volume 42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:09 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a526507-15b8-46b4-a76c-7547ca7e338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba21307-e322-42bd-ad0b-faac70fbfae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:09 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f 1073741824
Apr 22 02:43:09 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:09 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Volume volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 (05cbe4a2-2eb4-4f20-84db-5dff03977c57): created successfully
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba21307-e322-42bd-ad0b-faac70fbfae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:09 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Flow 'volume_create_manager' (e87def41-376a-44e4-82d7-9fb7520bc418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:09 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4042b729-bf7c-4f94-94f0-2d38c39be8a1 tempest-VolumeDependencyTests-2013414134 None] Created volume successfully.
Apr 22 02:43:10 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f 1073741824" returned: 0 in 0.556s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:10 devstack sudo[89607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f
Apr 22 02:43:10 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-1f2a55c2-6d0b-4ad6-8237-6c167b3fa445-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-1f2a55c2-6d0b-4ad6-8237-6c167b3fa445-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-quobyte-1f2a55c2-6d0b-4ad6-8237-6c167b3fa445" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-1f2a55c2-6d0b-4ad6-8237-6c167b3fa445" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Deleting offline snapshot 1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 of volume 91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] snapshot_file for this snap is: volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[01318642-65ba-4a0e-bd9c-54dd8a888219]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:10 devstack sudo[89609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445
Apr 22 02:43:10 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:10 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f" returned: 0 in 0.436s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.430s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abd779a-943f-4734-a8ed-6899a0ec25c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42aa9b49-2542-4feb-a2ad-175a193c468f', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcbe5f8-7d45-4680-aad7-23a009a3dc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:10 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Volume volume-42aa9b49-2542-4feb-a2ad-175a193c468f (42aa9b49-2542-4feb-a2ad-175a193c468f): created successfully
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afcbe5f8-7d45-4680-aad7-23a009a3dc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (a2d1512c-ab4e-4f50-bfd9-378ec407e619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Creating offline snapshot f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa of volume 05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:43:10 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-dcc788da-d4ab-4062-86a3-eb5503964100 tempest-VolumesSnapshotTestJSON-963446238 None] Created volume successfully.
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[46059012-7708-451f-b4fd-28db9baa9959]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:10 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57
Apr 22 02:43:10 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:11 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db411f-01a0-4e6b-8cdb-c12743e641c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ff12ae-ebcd-426c-8261-dc59700af6a2]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:11 devstack sudo[89617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317
Apr 22 02:43:11 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:11 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:11 devstack sudo[89622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa 1G
Apr 22 02:43:11 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:11 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317" returned: 0 in 0.462s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db411f-01a0-4e6b-8cdb-c12743e641c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:11 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445
Apr 22 02:43:11 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:11 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa 1G" returned: 0 in 0.515s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:11 devstack sudo[89633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa
Apr 22 02:43:11 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:12 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445" returned: 0 in 0.500s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:12 devstack sudo[89638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445
Apr 22 02:43:12 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:12 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" returned: 0 in 0.462s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:12 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa is being set with open permissions: ugo+rw
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:12 devstack sudo[89643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa
Apr 22 02:43:12 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:12 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.1f2a55c2-6d0b-4ad6-8237-6c167b3fa445" returned: 0 in 0.400s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-1f2a55c2-6d0b-4ad6-8237-6c167b3fa445" released by "_delete_snapshot" :: held 1.895s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" released by "delete_snapshot" :: held 1.907s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Created reservations ['7157dc2b-9888-4c74-bac4-655070246bc3', 'de56f925-1b30-4581-8432-5bb56cfb2833', 'e8b378e6-d566-4d9c-a7bd-f866d395c0c2', 'a833f806-e4c6-47a5-a030-5cbf54e8414d'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:12 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Delete snapshot completed successfully.
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d63e2f1f-0688-4d5d-84a6-1c3252066b1d tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-1f2a55c2-6d0b-4ad6-8237-6c167b3fa445-delete_snapshot" released by "delete_snapshot" :: held 1.986s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-cb7722c3-aebb-4690-b0b1-899cc8dd6317-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-cb7722c3-aebb-4690-b0b1-899cc8dd6317-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-quobyte-cb7722c3-aebb-4690-b0b1-899cc8dd6317" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-cb7722c3-aebb-4690-b0b1-899cc8dd6317" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Deleting offline snapshot cb7722c3-aebb-4690-b0b1-899cc8dd6317 of volume 91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] snapshot_file for this snap is: volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c83314-07ef-4899-bc6a-d2d276a49a38]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:12 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" returned: 0 in 0.436s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:12 devstack sudo[89647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317
Apr 22 02:43:12 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:12 devstack sudo[89655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.info
Apr 22 02:43:12 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:13 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317" returned: 0 in 0.476s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db411f-01a0-4e6b-8cdb-c12743e641c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:13 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.info" returned: 0 in 0.402s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:13 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.info is being set with open permissions: ugo+rw
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d216c302-29ae-4258-939c-1ec2172b065c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:13 devstack sudo[89661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.info
Apr 22 02:43:13 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:13 devstack sudo[89662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43
Apr 22 02:43:13 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:13 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.info" returned: 0 in 0.431s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.802s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.842s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Creating offline snapshot 2c74fc38-65bb-46f2-89bc-390b01c0c279 of volume 42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac3df30-3e47-492d-9710-0f5075202a7c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:13 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0fe8e8eb-da9f-4427-8656-c78c7d4b36e8 tempest-VolumeDependencyTests-2013414134 None] Create snapshot completed successfully
Apr 22 02:43:13 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43" returned: 0 in 0.489s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db411f-01a0-4e6b-8cdb-c12743e641c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:13 devstack sudo[89672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317
Apr 22 02:43:13 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:13 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f
Apr 22 02:43:13 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:14 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f" returned: 0 in 0.483s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:14 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317" returned: 0 in 0.462s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:14 devstack sudo[89681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 1G
Apr 22 02:43:14 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:14 devstack sudo[89682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317
Apr 22 02:43:14 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:14 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.cb7722c3-aebb-4690-b0b1-899cc8dd6317" returned: 0 in 0.425s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-cb7722c3-aebb-4690-b0b1-899cc8dd6317" released by "_delete_snapshot" :: held 1.905s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" released by "delete_snapshot" :: held 1.919s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Created reservations ['be84c52f-5643-4526-a146-82980699e463', '9337d2ba-40fc-4a6d-8eb1-c1ad345a89f0', 'ddee87e8-e362-49d8-8070-d59c7d48ac67', '15acb34d-f776-4733-ad9c-a1bb79753ab5'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:14 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 1G" returned: 0 in 0.524s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42aa9b49-2542-4feb-a2ad-175a193c468f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:14 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Delete snapshot completed successfully.
Apr 22 02:43:14 devstack sudo[89689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42aa9b49-2542-4feb-a2ad-175a193c468f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279
Apr 22 02:43:14 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e241b514-615c-4bef-b1e2-fa271fc9e6a2 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-cb7722c3-aebb-4690-b0b1-899cc8dd6317-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-da743a26-cb21-489d-83df-d21ce38b0d43-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-da743a26-cb21-489d-83df-d21ce38b0d43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Flow 'volume_create_manager' (9ee57453-fd2b-4804-9ce8-9c45540b2dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44651624-bd64-421e-9dc7-635b7d722495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-quobyte-da743a26-cb21-489d-83df-d21ce38b0d43" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44651624-bd64-421e-9dc7-635b7d722495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1572265717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f303be-85ba-4708-8277-6c8424fec828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41587c6a0e84f9d8751b63d1d593487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:15Z,use_quota=True,user_id='ad606b30e1044a1a841399b704a35d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33400225-467f-4260-8a29-9d729e4e9c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33400225-467f-4260-8a29-9d729e4e9c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904d01f6-976e-4ee7-98c9-3a96d742fbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904d01f6-976e-4ee7-98c9-3a96d742fbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b1f303be-85ba-4708-8277-6c8424fec828', 'volume_name': 'volume-b1f303be-85ba-4708-8277-6c8424fec828', 'volume_size': 1, 'snapshot_id': 'f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1bd472-387f-4e8c-9fac-f972c7960a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1bd472-387f-4e8c-9fac-f972c7960a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ab5d0a-98e5-4661-b953-7e12871a51c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:14 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Volume b1f303be-85ba-4708-8277-6c8424fec828: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b1f303be-85ba-4708-8277-6c8424fec828', 'volume_size': 1, 'snapshot_id': 'f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa'}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-da743a26-cb21-489d-83df-d21ce38b0d43" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Deleting offline snapshot da743a26-cb21-489d-83df-d21ce38b0d43 of volume 91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] snapshot_file for this snap is: volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7314d61f-6a96-4869-804d-3e8ac579d235]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:14 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43
Apr 22 02:43:14 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:15 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42aa9b49-2542-4feb-a2ad-175a193c468f -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279" returned: 0 in 0.474s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:15 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 is being set with open permissions: ugo+rw
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:15 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279
Apr 22 02:43:15 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:15 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91db411f-01a0-4e6b-8cdb-c12743e641c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[011faf61-13a1-48ba-82aa-c8097abe5aed]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:15 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1
Apr 22 02:43:15 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:15 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279" returned: 0 in 0.406s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:15 devstack sudo[89704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.info
Apr 22 02:43:15 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:15 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:15 devstack sudo[89709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43
Apr 22 02:43:15 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:15 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.info" returned: 0 in 0.417s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:15 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.info is being set with open permissions: ugo+rw
Apr 22 02:43:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:15 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.info
Apr 22 02:43:15 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:16 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:16 devstack sudo[89718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43
Apr 22 02:43:16 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:16 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.info" returned: 0 in 0.408s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.772s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.500s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa-b1f303be-85ba-4708-8277-6c8424fec828" by "_create_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa-b1f303be-85ba-4708-8277-6c8424fec828" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Creating volume b1f303be-85ba-4708-8277-6c8424fec828 from snapshot f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa {{(pid=82678) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-b1f303be-85ba-4708-8277-6c8424fec828" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:16 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a42a7636-cbfc-4a43-8ceb-381b82336729 tempest-VolumesSnapshotTestJSON-963446238 None] Create snapshot completed successfully
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-b1f303be-85ba-4708-8277-6c8424fec828" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] snapshot: f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa, volume: b1f303be-85ba-4708-8277-6c8424fec828,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede4a540-42ea-41a9-82d9-5ce3a9ed355d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:16 devstack sudo[89720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa
Apr 22 02:43:16 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:16 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1.da743a26-cb21-489d-83df-d21ce38b0d43" returned: 0 in 0.427s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-da743a26-cb21-489d-83df-d21ce38b0d43" released by "_delete_snapshot" :: held 1.865s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" released by "delete_snapshot" :: held 1.918s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Created reservations ['25b80ea1-fdfa-4b96-a8a8-48cb7818fc9f', '33d49ab0-dc1c-4f7d-bed5-7fb27511ec9e', 'f3eb011e-c433-47f5-b1ef-4217b05e8133', 'bda0c30d-84f7-47ad-b5bb-1eec2a79050f'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:16 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Delete snapshot completed successfully.
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f529ec06-6b36-40aa-959b-5089a90088cd tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-da743a26-cb21-489d-83df-d21ce38b0d43-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-91db411f-01a0-4e6b-8cdb-c12743e641c1-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-91db411f-01a0-4e6b-8cdb-c12743e641c1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:16 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" returned: 0 in 0.528s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd0dbd4-54ea-4356-9bda-b3ee17883c71]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[b858bf3a-35b0-43bc-8d28-58f2ae75de1c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:17 devstack sudo[89726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57
Apr 22 02:43:17 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:17 devstack sudo[89727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1
Apr 22 02:43:17 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (a9f9123b-b783-4a01-bcd7-2ab77a924cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf9568a-ad7a-4e09-afbb-6603f1223d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddf9568a-ad7a-4e09-afbb-6603f1223d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1363936439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5e1d893374fde9bc9182758b7e752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2c74fc38-65bb-46f2-89bc-390b01c0c279,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:17Z,use_quota=True,user_id='1e56a88b820b406b88b48f70aaec7c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb8df9f-9fd2-4566-9600-b4747f82af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb8df9f-9fd2-4566-9600-b4747f82af6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a32b513-fd73-43ac-84ec-0ee0a6225d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a32b513-fd73-43ac-84ec-0ee0a6225d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a', 'volume_name': 'volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a', 'volume_size': 2, 'snapshot_id': '2c74fc38-65bb-46f2-89bc-390b01c0c279'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963d9f2e-88ee-4796-ae16-781dcd222c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963d9f2e-88ee-4796-ae16-781dcd222c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514a23a6-1158-41b0-9b45-682003240249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:17 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Volume 3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a', 'volume_size': 2, 'snapshot_id': '2c74fc38-65bb-46f2-89bc-390b01c0c279'}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:17 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828 not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:17 devstack sudo[89736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828
Apr 22 02:43:17 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:17 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1" returned: 0 in 0.500s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:17 devstack sudo[89738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1
Apr 22 02:43:17 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:18 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-91db411f-01a0-4e6b-8cdb-c12743e641c1" returned: 0 in 0.642s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-quobyte-91db411f-01a0-4e6b-8cdb-c12743e641c1" released by "delete_volume" :: held 1.174s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Created reservations ['4abbc061-be53-4e8b-a014-7972e7c11ad3', '9c98847e-4a71-433a-93a3-ccb545bc724a', '4e48eeab-8c05-4e9b-8630-ea1dd2771ec2', '054b3577-3c08-40e4-be82-f56ee67d70c4'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:18 devstack sudo[89751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:18 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:19 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828" returned: 0 in 2.145s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:19 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[80165602-e180-4efe-b863-5b82ee211c01]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:19 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 1.324s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:19 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:19 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Deleted volume successfully.
Apr 22 02:43:19 devstack sudo[89788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57
Apr 22 02:43:19 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3a1539e6-00d1-4416-9d06-298ba0a63c44 tempest-VolumesSnapshotListTestJSON-1274184030 None] Lock "cinder-91db411f-01a0-4e6b-8cdb-c12743e641c1-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:20 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57" returned: 0 in 0.655s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:43:20 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Converted 1024.00 MB image at 477.09 MB/s
Apr 22 02:43:20 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828 is being set with open permissions: ugo+rw
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:20 devstack sudo[89793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828
Apr 22 02:43:20 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:20 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828" returned: 0 in 0.405s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-b1f303be-85ba-4708-8277-6c8424fec828" released by "_copy_volume_from_snapshot" :: held 4.292s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa-b1f303be-85ba-4708-8277-6c8424fec828" released by "_create_volume_from_snapshot" :: held 4.311s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.329s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.419s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-2c74fc38-65bb-46f2-89bc-390b01c0c279-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" by "_create_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-2c74fc38-65bb-46f2-89bc-390b01c0c279-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Creating volume 3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a from snapshot 2c74fc38-65bb-46f2-89bc-390b01c0c279 {{(pid=82678) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81ab5d0a-98e5-4661-b953-7e12871a51c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f303be-85ba-4708-8277-6c8424fec828', 'volume_size': 1, 'snapshot_id': 'f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7560f556-e4e4-43da-9a31-4b2eeeddb50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] snapshot: 2c74fc38-65bb-46f2-89bc-390b01c0c279, volume: 3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:43:20 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Volume volume-b1f303be-85ba-4708-8277-6c8424fec828 (b1f303be-85ba-4708-8277-6c8424fec828): created successfully
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7560f556-e4e4-43da-9a31-4b2eeeddb50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Flow 'volume_create_manager' (9ee57453-fd2b-4804-9ce8-9c45540b2dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[921cbc76-84aa-4084-acd3-8539ba4c5991]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:20 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d51cc94c-4fae-4ff2-9dec-5a716531d85f tempest-VolumeDependencyTests-2013414134 None] Created volume successfully.
Apr 22 02:43:20 devstack sudo[89796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279
Apr 22 02:43:20 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (0dd7f38e-7196-4440-a034-f45331cf65cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5046c428-9455-43e3-a848-43227215e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5046c428-9455-43e3-a848-43227215e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-927564368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940f5b35-163d-4043-bedf-dd31852a3dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:21Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef6e977-6181-4306-8527-7f1cab8a8443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef6e977-6181-4306-8527-7f1cab8a8443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b73f968-b068-42ae-9715-a4e3b627c8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b73f968-b068-42ae-9715-a4e3b627c8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '940f5b35-163d-4043-bedf-dd31852a3dd4', 'volume_name': 'volume-940f5b35-163d-4043-bedf-dd31852a3dd4', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db956884-ccbc-4a57-adb9-84fe8f630db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db956884-ccbc-4a57-adb9-84fe8f630db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9106053e-2ed4-4829-86f0-f98c0199d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Volume 940f5b35-163d-4043-bedf-dd31852a3dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-940f5b35-163d-4043-bedf-dd31852a3dd4', 'volume_size': 1}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-05cbe4a2-2eb4-4f20-84db-5dff03977c57" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (34b2e8e9-5de7-4cc6-b9e7-950a145e9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79006870-d763-49fc-b859-e6792257d0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-05cbe4a2-2eb4-4f20-84db-5dff03977c57" acquired by "delete_snapshot" :: waited 0.049s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79006870-d763-49fc-b859-e6792257d0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-614119322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23bd5522-761e-421e-8654-2626578524fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:21Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f0820e-1fda-47f4-b25b-0d3fc4aa5bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f0820e-1fda-47f4-b25b-0d3fc4aa5bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce63f859-7340-4fe4-9df8-e3254a71b033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce63f859-7340-4fe4-9df8-e3254a71b033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23bd5522-761e-421e-8654-2626578524fa', 'volume_name': 'volume-23bd5522-761e-421e-8654-2626578524fa', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167692f1-d7bc-4c7a-8cb4-d0bc2b9309d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167692f1-d7bc-4c7a-8cb4-d0bc2b9309d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c8a25a-951e-4a03-8a02-0064fbb899e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Volume 23bd5522-761e-421e-8654-2626578524fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23bd5522-761e-421e-8654-2626578524fa', 'volume_size': 1}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Deleting offline snapshot f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa of volume 05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] snapshot_file for this snap is: volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279" returned: 0 in 0.581s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42aa9b49-2542-4feb-a2ad-175a193c468f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a6a735-ed32-4e4d-98e5-00f71ccae59b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[104cbca6-40de-413a-99e6-e6d116d1b5df]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:21 devstack sudo[89801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa
Apr 22 02:43:21 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (3ab82db6-89d2-443e-8539-769e40878eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89a7081-0a45-4538-8d5c-ce946a374c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f
Apr 22 02:43:21 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89a7081-0a45-4538-8d5c-ce946a374c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-930538342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f833b8c-b889-4fa5-900e-9522ae85b6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:21Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70a7653-e2b8-47fb-acec-f27efd894a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d70a7653-e2b8-47fb-acec-f27efd894a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95e86fa-1f2c-4915-a1c4-9b4bc5a52f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95e86fa-1f2c-4915-a1c4-9b4bc5a52f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f833b8c-b889-4fa5-900e-9522ae85b6f7', 'volume_name': 'volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff5a505-ffd9-4d5f-879e-d67be53a1d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff5a505-ffd9-4d5f-879e-d67be53a1d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fd418c-075e-4bd4-83aa-5c27323bc971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Volume 0f833b8c-b889-4fa5-900e-9522ae85b6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7', 'volume_size': 1}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (f2c055e2-f5cf-4207-af52-19aeea32421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79e3f5d-aa33-4d55-a34f-230f21acba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79e3f5d-aa33-4d55-a34f-230f21acba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-721875532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:22Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4287414-c964-4ca2-bcbe-9fa5963389a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4287414-c964-4ca2-bcbe-9fa5963389a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0850937d-08d5-4ccc-b929-62999cfd4b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0850937d-08d5-4ccc-b929-62999cfd4b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7', 'volume_name': 'volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8f69c1-a0be-4a86-aa0b-c864bc6d569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8f69c1-a0be-4a86-aa0b-c864bc6d569f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652bfd69-ff35-406d-b0ca-e932ec0da25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Volume 240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7', 'volume_size': 1}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (d62320d9-cf61-4026-859d-ee9fbe8c0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e69097-b387-45d3-99ca-e9ad70522f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e69097-b387-45d3-99ca-e9ad70522f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1477186990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4db840-946e-4c3a-aa9a-0b26edbe98c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:22Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6955d55-3cee-41b8-b04f-efd4c32b0a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6955d55-3cee-41b8-b04f-efd4c32b0a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec7f478-e441-49be-91a0-8258357f4c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec7f478-e441-49be-91a0-8258357f4c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4db840-946e-4c3a-aa9a-0b26edbe98c2', 'volume_name': 'volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08a51b1-b997-434a-8160-d55069fad780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e08a51b1-b997-434a-8160-d55069fad780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc99e2d-8032-49ab-b375-989e712e4aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:21 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Volume cd4db840-946e-4c3a-aa9a-0b26edbe98c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2', 'volume_size': 1}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:21 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" returned: 0 in 0.568s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0510374f-4d3e-4d4d-9f13-8b296d7b5f67]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:21 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f" returned: 0 in 0.579s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:43:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:22 devstack sudo[89813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a
Apr 22 02:43:22 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:22 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57
Apr 22 02:43:22 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:22 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57" returned: 0 in 0.727s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:22 devstack sudo[89829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa
Apr 22 02:43:22 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:23 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" returned: 0 in 0.952s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:23 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa
Apr 22 02:43:23 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:24 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" returned: 0 in 2.117s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee851e5-7047-4016-b11b-0ee14a0af666]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:24 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f
Apr 22 02:43:24 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:24 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57.f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" returned: 0 in 0.597s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa" released by "_delete_snapshot" :: held 2.913s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-05cbe4a2-2eb4-4f20-84db-5dff03977c57" released by "delete_snapshot" :: held 2.973s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Created reservations ['4f8aa7d1-7f9a-4433-a943-f0263e096ca6', '424d5126-d336-4ea6-abe6-a7672c97b04e', '4732d083-b2ef-42cc-a749-a962cc512e4c', '7fbd2e67-0960-4ed9-a4e7-477fd41e9af9'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:24 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Delete snapshot completed successfully.
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c089d8d-50b2-4b80-8936-86596956c708 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-f7a8f32d-5fe0-4ed5-874d-8e58e7cbcbaa-delete_snapshot" released by "delete_snapshot" :: held 3.104s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-05cbe4a2-2eb4-4f20-84db-5dff03977c57-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-05cbe4a2-2eb4-4f20-84db-5dff03977c57-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-05cbe4a2-2eb4-4f20-84db-5dff03977c57" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-05cbe4a2-2eb4-4f20-84db-5dff03977c57" acquired by "delete_volume" :: waited 0.017s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f8cea5-b147-465f-9510-4d183df6be8d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:24 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57
Apr 22 02:43:24 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:24 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f" returned: 0 in 0.630s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f, size 1024.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:43:24 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Converted 1024.00 MB image at 483.40 MB/s
Apr 22 02:43:24 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a is being set with open permissions: ugo+rw
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:24 devstack sudo[89844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a
Apr 22 02:43:24 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:24 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57" returned: 0 in 0.472s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:24 devstack sudo[89849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57
Apr 22 02:43:24 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:25 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" returned: 0 in 0.426s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" released by "_copy_volume_from_snapshot" :: held 4.416s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-2c74fc38-65bb-46f2-89bc-390b01c0c279-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" released by "_create_volume_from_snapshot" :: held 4.440s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.460s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.040s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-927564368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940f5b35-163d-4043-bedf-dd31852a3dd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:21Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Creating volume 940f5b35-163d-4043-bedf-dd31852a3dd4 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:25 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:25 devstack sudo[89852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4 1073741824
Apr 22 02:43:25 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514a23a6-1158-41b0-9b45-682003240249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a', 'volume_size': 2, 'snapshot_id': '2c74fc38-65bb-46f2-89bc-390b01c0c279'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132289aa-8848-4871-aa51-28ec726611c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:25 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Volume volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a (3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a): created successfully
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132289aa-8848-4871-aa51-28ec726611c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (a9f9123b-b783-4a01-bcd7-2ab77a924cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:25 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-888bc4ca-d052-48c4-8700-166e89add633 tempest-VolumesSnapshotTestJSON-963446238 None] Created volume successfully.
Apr 22 02:43:25 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-05cbe4a2-2eb4-4f20-84db-5dff03977c57" returned: 0 in 0.424s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-05cbe4a2-2eb4-4f20-84db-5dff03977c57" released by "delete_volume" :: held 0.921s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Created reservations ['d034553e-1373-46dd-be4d-7196a15d57dc', '28ba2968-7620-4e02-8268-0702af5309c6', '3805b709-ca42-4c64-8869-49e73a6e5865', 'ba3385fa-ce0a-4d50-945b-6593fa547e40'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:25 devstack sudo[89855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:25 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:25 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4 1073741824" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Flow 'volume_create_manager' (a560a868-d638-46ac-871a-b52a43bdde71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a1df34-62d6-475c-a552-10581b903770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:25 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4
Apr 22 02:43:25 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a1df34-62d6-475c-a552-10581b903770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-55042566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846f16ec-6dde-4e4a-84ea-aef0a49ac60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41587c6a0e84f9d8751b63d1d593487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:26Z,use_quota=True,user_id='ad606b30e1044a1a841399b704a35d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb3441f-0ade-482e-84f9-616b5f3b727e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb3441f-0ade-482e-84f9-616b5f3b727e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef38dc-8b4c-4c58-828a-ba10ae6e55dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fef38dc-8b4c-4c58-828a-ba10ae6e55dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846f16ec-6dde-4e4a-84ea-aef0a49ac60b', 'volume_name': 'volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cac3c0-521f-40de-8c38-3a5f387494d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cac3c0-521f-40de-8c38-3a5f387494d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7e62d0-3ab9-4ce8-a58f-00f3f671149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:25 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Volume 846f16ec-6dde-4e4a-84ea-aef0a49ac60b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b', 'volume_size': 1}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:25 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.472s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:25 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Deleted volume successfully.
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-c01e1f8c-5f00-4a47-9149-12d623e45feb tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-05cbe4a2-2eb4-4f20-84db-5dff03977c57-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[96127e92-c919-4215-b59a-f20e7c1ac6a0]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:26 devstack sudo[89863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a
Apr 22 02:43:26 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:26 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4" returned: 0 in 0.444s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.876s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-614119322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23bd5522-761e-421e-8654-2626578524fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:21Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Creating volume 23bd5522-761e-421e-8654-2626578524fa {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:26 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9106053e-2ed4-4829-86f0-f98c0199d33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940f5b35-163d-4043-bedf-dd31852a3dd4', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e867cea4-eba5-486e-b0f3-8f204b2bf529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:26 devstack sudo[89866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa 1073741824
Apr 22 02:43:26 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:26 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Volume volume-940f5b35-163d-4043-bedf-dd31852a3dd4 (940f5b35-163d-4043-bedf-dd31852a3dd4): created successfully
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e867cea4-eba5-486e-b0f3-8f204b2bf529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (0dd7f38e-7196-4440-a034-f45331cf65cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:26 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a71c6630-ebe4-4ae4-985e-589759ac4ad6 tempest-CreateVolumesFromImageTest-1724517943 None] Created volume successfully.
Apr 22 02:43:26 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" returned: 0 in 0.484s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:26 devstack sudo[89871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a
Apr 22 02:43:26 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:26 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa 1073741824" returned: 0 in 0.485s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:26 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa
Apr 22 02:43:26 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:26 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" returned: 0 in 0.410s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a" released by "delete_volume" :: held 0.921s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Created reservations ['5276c847-8fdb-434a-bcea-a6cd8a4b7492', 'e1defdc4-a3a2-4057-a9de-38ce49ac9912', '223659aa-928e-434a-9466-127c8bf8184e', '27b6a4f0-c3d3-423e-9d41-b70d9ce39057'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:27 devstack sudo[89879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:27 devstack sudo[89879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-2c74fc38-65bb-46f2-89bc-390b01c0c279-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-2c74fc38-65bb-46f2-89bc-390b01c0c279-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-42aa9b49-2542-4feb-a2ad-175a193c468f" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-42aa9b49-2542-4feb-a2ad-175a193c468f" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-2c74fc38-65bb-46f2-89bc-390b01c0c279" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-2c74fc38-65bb-46f2-89bc-390b01c0c279" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Deleting offline snapshot 2c74fc38-65bb-46f2-89bc-390b01c0c279 of volume 42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] snapshot_file for this snap is: volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8eeb7a-f9ab-43ab-a0ea-cac9a838246e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:27 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa" returned: 0 in 0.456s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:27 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279
Apr 22 02:43:27 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.701s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-930538342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f833b8c-b889-4fa5-900e-9522ae85b6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:21Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Creating volume 0f833b8c-b889-4fa5-900e-9522ae85b6f7 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:27 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c8a25a-951e-4a03-8a02-0064fbb899e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23bd5522-761e-421e-8654-2626578524fa', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:27 devstack sudo[89884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7 1073741824
Apr 22 02:43:27 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7301123-2049-4332-8c18-2314e9bb411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:27 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Volume volume-23bd5522-761e-421e-8654-2626578524fa (23bd5522-761e-421e-8654-2626578524fa): created successfully
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7301123-2049-4332-8c18-2314e9bb411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (34b2e8e9-5de7-4cc6-b9e7-950a145e9790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:27 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4fe25907-b53d-414f-b5a1-9f77b7678c63 tempest-CreateVolumesFromImageTest-1724517943 None] Created volume successfully.
Apr 22 02:43:27 devstack sudo[89879]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.423s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:27 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Deleted volume successfully.
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2f5a526-029d-44b2-846a-e4d281af34c2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-3eb7e5a1-a6ec-4e07-bfe8-54aaa5d0e08a-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:27 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279" returned: 0 in 0.456s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42aa9b49-2542-4feb-a2ad-175a193c468f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d53d3d-a987-4f2b-abf6-7cf1a52314dd]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:27 devstack sudo[89893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f
Apr 22 02:43:27 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:27 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7 1073741824" returned: 0 in 0.489s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:27 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7
Apr 22 02:43:27 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:28 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f" returned: 0 in 0.467s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:28 devstack sudo[89901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279
Apr 22 02:43:28 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:28 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7" returned: 0 in 0.406s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.391s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-721875532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:22Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Creating volume 240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:28 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fd418c-075e-4bd4-83aa-5c27323bc971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98c2318-b599-4461-928d-2280584ed31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:28 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Volume volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7 (0f833b8c-b889-4fa5-900e-9522ae85b6f7): created successfully
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a98c2318-b599-4461-928d-2280584ed31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:28 devstack sudo[89903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7 1073741824
Apr 22 02:43:28 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (3ab82db6-89d2-443e-8539-769e40878eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f61be9c6-389e-4571-9814-94ab175862e1 tempest-CreateVolumesFromImageTest-1724517943 None] Created volume successfully.
Apr 22 02:43:28 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:28 devstack sudo[89908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279
Apr 22 02:43:28 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:28 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7 1073741824" returned: 0 in 0.518s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:28 devstack sudo[89913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7
Apr 22 02:43:28 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:28 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f.2c74fc38-65bb-46f2-89bc-390b01c0c279" returned: 0 in 0.444s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-2c74fc38-65bb-46f2-89bc-390b01c0c279" released by "_delete_snapshot" :: held 1.852s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-42aa9b49-2542-4feb-a2ad-175a193c468f" released by "delete_snapshot" :: held 1.867s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Created reservations ['1ff62408-dea9-4be3-a264-693b476f54ff', 'c5a1fdc6-abaf-4c85-a399-a2c3ccc88296', '2a0cb2e0-960e-4cff-9d95-82a07c909b72', '89813233-e0b5-4354-b6bd-92bf77a21ce8'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:29 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Delete snapshot completed successfully.
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f043a870-fadc-4112-af88-3758d7915af9 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-2c74fc38-65bb-46f2-89bc-390b01c0c279-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:29 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7" returned: 0 in 0.423s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.251s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1477186990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4db840-946e-4c3a-aa9a-0b26edbe98c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06ccbdb2ab8945c2928570ec35cd3c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:22Z,use_quota=True,user_id='b0328a0e06d843edb8e0ea8477285b39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Creating volume cd4db840-946e-4c3a-aa9a-0b26edbe98c2 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:29 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652bfd69-ff35-406d-b0ca-e932ec0da25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:29 devstack sudo[89917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2 1073741824
Apr 22 02:43:29 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5791c1f7-7108-4ff6-b3cb-dafc7c90e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:29 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Volume volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7 (240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7): created successfully
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5791c1f7-7108-4ff6-b3cb-dafc7c90e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (f2c055e2-f5cf-4207-af52-19aeea32421f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:29 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-07853083-4430-4a92-8c53-553679c8f515 tempest-CreateVolumesFromImageTest-1724517943 None] Created volume successfully.
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-42aa9b49-2542-4feb-a2ad-175a193c468f-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-42aa9b49-2542-4feb-a2ad-175a193c468f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-42aa9b49-2542-4feb-a2ad-175a193c468f" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-42aa9b49-2542-4feb-a2ad-175a193c468f" acquired by "delete_volume" :: waited 0.021s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c5a146-7642-4fc2-8a77-ac88fb3d7c1a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:29 devstack sudo[89919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f
Apr 22 02:43:29 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:29 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2 1073741824" returned: 0 in 0.504s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:29 devstack sudo[89924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2
Apr 22 02:43:29 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:29 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f" returned: 0 in 0.488s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:29 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f
Apr 22 02:43:29 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:30 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2" returned: 0 in 0.418s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.259s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-55042566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846f16ec-6dde-4e4a-84ea-aef0a49ac60b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41587c6a0e84f9d8751b63d1d593487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:26Z,use_quota=True,user_id='ad606b30e1044a1a841399b704a35d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Creating volume 846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:30 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc99e2d-8032-49ab-b375-989e712e4aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:30 devstack sudo[89932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b 1073741824
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0614a0f-e097-41a6-b813-2c098226c196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:30 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:30 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Volume volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2 (cd4db840-946e-4c3a-aa9a-0b26edbe98c2): created successfully
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0614a0f-e097-41a6-b813-2c098226c196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Flow 'volume_create_manager' (d62320d9-cf61-4026-859d-ee9fbe8c0171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:UPDATE=243,cinder:INSERT=69,cinder:DELETE=22,cinder:SELECT=192 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:43:30 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6b6286c3-73a2-4d29-8096-2578a4c09dbc tempest-CreateVolumesFromImageTest-1724517943 None] Created volume successfully.
Apr 22 02:43:30 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42aa9b49-2542-4feb-a2ad-175a193c468f" returned: 0 in 0.438s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-42aa9b49-2542-4feb-a2ad-175a193c468f" released by "delete_volume" :: held 0.953s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Created reservations ['f12b9ed8-4bd4-4c68-b2dc-19915d72c805', '037d280b-1309-4d25-b5cb-f138cf1c19d9', 'd8ddfee0-4f18-4026-bd1c-ba8730195b11', 'be63ceeb-0c50-4fd7-ad85-00f265587a57'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:30 devstack sudo[89935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:30 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-cd4db840-946e-4c3a-aa9a-0b26edbe98c2-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-cd4db840-946e-4c3a-aa9a-0b26edbe98c2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-quobyte-cd4db840-946e-4c3a-aa9a-0b26edbe98c2" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-cd4db840-946e-4c3a-aa9a-0b26edbe98c2" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[592cb5bb-ddf9-4422-bddf-cb367706e0bf]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:30 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b 1073741824" returned: 0 in 0.592s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:30 devstack sudo[89940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2
Apr 22 02:43:30 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:30 devstack sudo[89942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b
Apr 22 02:43:30 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (a2bafe69-ccf3-4828-99d1-b3adea781235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcaa976-06ff-48f8-b887-52efaa8044da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcaa976-06ff-48f8-b887-52efaa8044da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-268632079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e3a530-763a-48c5-a204-8f67a525cb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5e1d893374fde9bc9182758b7e752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:31Z,use_quota=True,user_id='1e56a88b820b406b88b48f70aaec7c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94348a7-7caf-4647-a90e-f53ede07f7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94348a7-7caf-4647-a90e-f53ede07f7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ad025d-1ead-4144-a53a-96cb094bc85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ad025d-1ead-4144-a53a-96cb094bc85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e3a530-763a-48c5-a204-8f67a525cb0c', 'volume_name': 'volume-c2e3a530-763a-48c5-a204-8f67a525cb0c', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea98c5b-2e2d-4422-8994-946ccd9aa4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea98c5b-2e2d-4422-8994-946ccd9aa4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499ec777-d783-42a6-8744-f394f34df1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:30 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Volume c2e3a530-763a-48c5-a204-8f67a525cb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e3a530-763a-48c5-a204-8f67a525cb0c', 'volume_size': 1}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:30 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.495s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:30 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Deleted volume successfully.
Apr 22 02:43:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a66a406-0b59-4313-85f9-a265d940fd6a tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-42aa9b49-2542-4feb-a2ad-175a193c468f-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:31 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2" returned: 0 in 0.537s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:31 devstack sudo[89949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2
Apr 22 02:43:31 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:31 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" returned: 0 in 0.439s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-268632079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e3a530-763a-48c5-a204-8f67a525cb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5e1d893374fde9bc9182758b7e752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:31Z,use_quota=True,user_id='1e56a88b820b406b88b48f70aaec7c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Creating volume c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:31 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb7e62d0-3ab9-4ce8-a58f-00f3f671149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:31 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c 1073741824
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb776364-7e1a-4e7a-9d58-780c4ecd544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:31 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:31 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Volume volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b (846f16ec-6dde-4e4a-84ea-aef0a49ac60b): created successfully
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb776364-7e1a-4e7a-9d58-780c4ecd544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Flow 'volume_create_manager' (a560a868-d638-46ac-871a-b52a43bdde71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0c2edc0c-fb60-4631-9d43-b10abdd8f01f tempest-VolumeDependencyTests-2013414134 None] Created volume successfully.
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:31 devstack sudo[89953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:31 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:31 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-cd4db840-946e-4c3a-aa9a-0b26edbe98c2" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-cd4db840-946e-4c3a-aa9a-0b26edbe98c2" released by "delete_volume" :: held 1.002s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Created reservations ['fec1bed5-c22b-4e25-bfd0-61a952e5f0d2', 'fbaabeba-4911-4794-b55b-fa5dc2901c81', 'b91c8b38-0bcd-4769-ba44-f59bf002fed1', 'cb243a48-db1c-466b-99cb-75b0836845bf'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:31 devstack sudo[89959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:31 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:31 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c 1073741824" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:31 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c
Apr 22 02:43:31 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:31 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.472s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:32 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.428s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:32 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Deleted volume successfully.
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8a2bbdd0-84ba-4989-a5f1-b1f526ef1b67 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-cd4db840-946e-4c3a-aa9a-0b26edbe98c2-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:32 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c" returned: 0 in 0.443s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499ec777-d783-42a6-8744-f394f34df1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e3a530-763a-48c5-a204-8f67a525cb0c', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1759d822-4011-466d-be12-d4d4c402e05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:32 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Volume volume-c2e3a530-763a-48c5-a204-8f67a525cb0c (c2e3a530-763a-48c5-a204-8f67a525cb0c): created successfully
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1759d822-4011-466d-be12-d4d4c402e05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (a2bafe69-ccf3-4828-99d1-b3adea781235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:32 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c215c7a9-87a5-4f83-bd4d-0c2e5ad87a61 tempest-VolumesSnapshotTestJSON-963446238 None] Created volume successfully.
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Flow 'volume_create_manager' (cbbcbfd0-1487-4692-a83b-a6fb4149840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d012b8-595e-4123-81d9-44fc8e54a269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d012b8-595e-4123-81d9-44fc8e54a269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-285392647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cbce0c-23af-4465-8673-cf76c437490c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41587c6a0e84f9d8751b63d1d593487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=846f16ec-6dde-4e4a-84ea-aef0a49ac60b,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:32Z,use_quota=True,user_id='ad606b30e1044a1a841399b704a35d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fe4c01-f409-41d9-9cd2-09c861c4e0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fe4c01-f409-41d9-9cd2-09c861c4e0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32fc00e6-b41f-4c61-be9c-fe2bdaaa4162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32fc00e6-b41f-4c61-be9c-fe2bdaaa4162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '73cbce0c-23af-4465-8673-cf76c437490c', 'volume_name': 'volume-73cbce0c-23af-4465-8673-cf76c437490c', 'volume_size': 1, 'source_volid': '846f16ec-6dde-4e4a-84ea-aef0a49ac60b', 'source_volstatus': 'available'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc206a23-84bf-441f-889c-600e5d3035b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc206a23-84bf-441f-889c-600e5d3035b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242ba5d4-a2ea-43a7-aab0-fdb5846f10f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:32 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Volume 73cbce0c-23af-4465-8673-cf76c437490c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-73cbce0c-23af-4465-8673-cf76c437490c', 'volume_size': 1, 'source_volid': '846f16ec-6dde-4e4a-84ea-aef0a49ac60b', 'source_volstatus': 'available'}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:32 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Cloning volume 846f16ec-6dde-4e4a-84ea-aef0a49ac60b to volume 73cbce0c-23af-4465-8673-cf76c437490c
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Creating offline snapshot 6ce5328b-3864-46be-b496-dd444488bfe5 of volume 846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[353dc900-d23b-4a44-9151-b912f8da49a2]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:32 devstack sudo[89967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b
Apr 22 02:43:32 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-quobyte-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d10a2d-42bd-47f6-a96a-e60a736a0652]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:32 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7
Apr 22 02:43:32 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:32 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" returned: 0 in 0.566s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:32 devstack sudo[89974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 1G
Apr 22 02:43:32 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:33 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7" returned: 0 in 0.542s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:33 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7
Apr 22 02:43:33 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:33 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 1G" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:33 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5
Apr 22 02:43:33 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:33 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7" returned: 0 in 0.441s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7" released by "delete_volume" :: held 1.006s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Created reservations ['18fc860e-5507-4e6f-aece-2c4c324b161c', 'f3fa21b4-df32-484a-9b04-37f6ca6309f4', 'cc655102-0e8e-4621-9f73-1d3c84b2dbea', 'b63a8648-3652-47cf-a4fb-9c62cd5a2bb7'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:33 devstack sudo[89990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:33 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:33 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5" returned: 0 in 0.444s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:33 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 is being set with open permissions: ugo+rw
Apr 22 02:43:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:33 devstack sudo[89992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5
Apr 22 02:43:33 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:34 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.423s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:34 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Deleted volume successfully.
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a7de990e-de3a-4766-b7b3-acd6f44b5a2f tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-240acc1c-bcb2-4a1b-b3b3-e90a936bc0d7-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:34 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5" returned: 0 in 0.417s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:34 devstack sudo[89996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.info
Apr 22 02:43:34 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:34 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.info" returned: 0 in 0.409s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:34 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.info is being set with open permissions: ugo+rw
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:34 devstack sudo[89999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.info
Apr 22 02:43:34 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-0f833b8c-b889-4fa5-900e-9522ae85b6f7-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-0f833b8c-b889-4fa5-900e-9522ae85b6f7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-quobyte-0f833b8c-b889-4fa5-900e-9522ae85b6f7" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-0f833b8c-b889-4fa5-900e-9522ae85b6f7" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09136d5-d14b-4c84-948f-5009335b5e50]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:34 devstack sudo[90001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7
Apr 22 02:43:34 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:35 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.info" returned: 0 in 0.462s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-73cbce0c-23af-4465-8673-cf76c437490c" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-73cbce0c-23af-4465-8673-cf76c437490c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] snapshot: 6ce5328b-3864-46be-b496-dd444488bfe5, volume: 73cbce0c-23af-4465-8673-cf76c437490c,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[5729b25c-c24c-4f52-a160-1def81a466bf]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:35 devstack sudo[90004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5
Apr 22 02:43:35 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:35 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7" returned: 0 in 0.493s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:35 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7
Apr 22 02:43:35 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:35 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5" returned: 0 in 0.503s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a398048-b205-44cb-a647-728c4e49c8a5]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:35 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0f833b8c-b889-4fa5-900e-9522ae85b6f7" returned: 0 in 0.420s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:35 devstack sudo[90015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b
Apr 22 02:43:35 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-0f833b8c-b889-4fa5-900e-9522ae85b6f7" released by "delete_volume" :: held 0.934s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Created reservations ['8e84571c-87ff-4b3e-a89d-b15489e7f5c2', '86341dde-719d-4500-a230-beb0b06690e3', '1759caaa-e2c2-42c4-93ec-e9589311b2cb', 'b5e3ec4f-a14d-4fde-91e4-589973c1ecb5'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:35 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:35 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-23bd5522-761e-421e-8654-2626578524fa-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-23bd5522-761e-421e-8654-2626578524fa-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-quobyte-23bd5522-761e-421e-8654-2626578524fa" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-23bd5522-761e-421e-8654-2626578524fa" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfdb0cb-c5a9-4922-8857-703b49a40365]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:36 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa
Apr 22 02:43:36 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:36 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" returned: 0 in 0.509s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:36 devstack sudo[90024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c
Apr 22 02:43:36 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:36 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.463s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:36 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Deleted volume successfully.
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-e5f4bfb8-7722-4c16-8758-3aef22bb1718 tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-0f833b8c-b889-4fa5-900e-9522ae85b6f7-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:36 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa" returned: 0 in 0.510s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:36 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa
Apr 22 02:43:36 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:37 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-23bd5522-761e-421e-8654-2626578524fa" returned: 0 in 0.496s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-23bd5522-761e-421e-8654-2626578524fa" released by "delete_volume" :: held 1.044s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Created reservations ['14497eba-5370-468f-a491-b6b3bc2081a8', 'ee99c208-cf00-4e86-859d-961972f923aa', 'd21f1489-9505-4979-8704-83afe8c495ca', 'ea6404d7-47a0-4822-bd53-76f096ac29fb'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:37 devstack sudo[90044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:37 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-940f5b35-163d-4043-bedf-dd31852a3dd4-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-940f5b35-163d-4043-bedf-dd31852a3dd4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "cinder-quobyte-940f5b35-163d-4043-bedf-dd31852a3dd4" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-940f5b35-163d-4043-bedf-dd31852a3dd4" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:38 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c" returned: 0 in 2.131s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab1ad4f-c799-4144-9c16-cb9abf27f3dd]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7509e62a-74ac-4ae6-a9a5-fa78ce40137c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:38 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 1.065s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:38 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Deleted volume successfully.
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-19a74220-d858-4394-9cd9-7ccf504ca08b tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-23bd5522-761e-421e-8654-2626578524fa-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:38 devstack sudo[90047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4
Apr 22 02:43:38 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:38 devstack sudo[90048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b
Apr 22 02:43:38 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:38 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:38 devstack sudo[90056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4
Apr 22 02:43:38 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:39 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" returned: 0 in 0.646s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:43:39 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Converted 1024.00 MB image at 480.22 MB/s
Apr 22 02:43:39 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c is being set with open permissions: ugo+rw
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:39 devstack sudo[90060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c
Apr 22 02:43:39 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:39 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-940f5b35-163d-4043-bedf-dd31852a3dd4" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-quobyte-940f5b35-163d-4043-bedf-dd31852a3dd4" released by "delete_volume" :: held 0.968s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Created reservations ['b5549240-f78e-4d4c-bf44-be79164e6e2c', '48464fee-f56e-4a7f-804e-5520416960b6', 'a2867106-e3c7-43e3-ba83-5f0693f4af4a', 'bbcd912e-4acb-4dd7-9b34-329e9d031db2'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:39 devstack sudo[90064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:39 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:39 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c" returned: 0 in 0.425s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-73cbce0c-23af-4465-8673-cf76c437490c" released by "_copy_volume_from_snapshot" :: held 4.269s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-6ce5328b-3864-46be-b496-dd444488bfe5" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-6ce5328b-3864-46be-b496-dd444488bfe5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Deleting offline snapshot 6ce5328b-3864-46be-b496-dd444488bfe5 of volume 846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] snapshot_file for this snap is: volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a498e8-7149-4d0c-9cb7-a5e5d1a9f838]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:39 devstack sudo[90066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5
Apr 22 02:43:39 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:39 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.439s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:39 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Deleted volume successfully.
Apr 22 02:43:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bac0ec4c-0a35-4fc3-b8e4-31c37d0e53de tempest-CreateVolumesFromImageTest-1724517943 None] Lock "cinder-940f5b35-163d-4043-bedf-dd31852a3dd4-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:40 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:40 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eee6003-4b81-45af-a6cc-fb6c608340a3]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:40 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b
Apr 22 02:43:40 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:40 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" returned: 0 in 0.500s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:40 devstack sudo[90077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5
Apr 22 02:43:40 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:41 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:41 devstack sudo[90082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5
Apr 22 02:43:41 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:41 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b.6ce5328b-3864-46be-b496-dd444488bfe5" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-6ce5328b-3864-46be-b496-dd444488bfe5" released by "_delete_snapshot" :: held 1.947s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.097s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.521s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242ba5d4-a2ea-43a7-aab0-fdb5846f10f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cbce0c-23af-4465-8673-cf76c437490c', 'volume_size': 1, 'source_volid': '846f16ec-6dde-4e4a-84ea-aef0a49ac60b', 'source_volstatus': 'available'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2b2d6c-af4d-4906-b35d-e139de6e2b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Creating offline snapshot 48509d96-30db-41b5-aa9f-b2266fc8acf8 of volume c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:43:41 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Volume volume-73cbce0c-23af-4465-8673-cf76c437490c (73cbce0c-23af-4465-8673-cf76c437490c): created successfully
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc2b2d6c-af4d-4906-b35d-e139de6e2b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Flow 'volume_create_manager' (cbbcbfd0-1487-4692-a83b-a6fb4149840b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d363631-5457-415a-b070-06c2afa596fb]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:41 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-dcf70272-517f-41a6-bca8-fac0d7f98794 tempest-VolumeDependencyTests-2013414134 None] Created volume successfully.
Apr 22 02:43:41 devstack sudo[90085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c
Apr 22 02:43:41 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-846f16ec-6dde-4e4a-84ea-aef0a49ac60b-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-846f16ec-6dde-4e4a-84ea-aef0a49ac60b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef42ce-4f9c-4f0b-9edd-8bd7f6737404]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:41 devstack sudo[90088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b
Apr 22 02:43:41 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:42 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c" returned: 0 in 0.529s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:42 devstack sudo[90093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 1G
Apr 22 02:43:42 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:42 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (8a7c154b-b4e1-4b05-9fc2-b5a3a31b731e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e38c460-fa2c-41eb-90a4-0bab465d8d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e38c460-fa2c-41eb-90a4-0bab465d8d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-731477723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392f3282-6eff-43c7-8212-109ea00ffeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:42Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:42 devstack sudo[90098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b64a46-a454-4e42-97c1-97a36854d120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:42 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b64a46-a454-4e42-97c1-97a36854d120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21a964c-e73d-4292-91a7-45b6a8103840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21a964c-e73d-4292-91a7-45b6a8103840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392f3282-6eff-43c7-8212-109ea00ffeb7', 'volume_name': 'volume-392f3282-6eff-43c7-8212-109ea00ffeb7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818fcf8b-3406-4427-a346-2b824b41278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (818fcf8b-3406-4427-a346-2b824b41278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84efa164-c695-467a-937e-625d17125cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:42 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume 392f3282-6eff-43c7-8212-109ea00ffeb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392f3282-6eff-43c7-8212-109ea00ffeb7', 'volume_size': 1}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:42 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 1G" returned: 0 in 0.555s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e3a530-763a-48c5-a204-8f67a525cb0c -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:42 devstack sudo[90103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e3a530-763a-48c5-a204-8f67a525cb0c -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8
Apr 22 02:43:42 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:42 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" returned: 0 in 0.424s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-846f16ec-6dde-4e4a-84ea-aef0a49ac60b" released by "delete_volume" :: held 1.009s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Created reservations ['d0afef94-bf6a-4399-b8f0-9c20c69ee1d3', 'ddaf9394-f427-42d3-88bf-06a23427e21a', '551acb82-c279-4353-b40a-427c625072e1', '5afa0f15-b0cd-4f4a-af17-417ab4c48b9d'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:42 devstack sudo[90106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:42 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:43 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e3a530-763a-48c5-a204-8f67a525cb0c -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:43 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 is being set with open permissions: ugo+rw
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:43 devstack sudo[90111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8
Apr 22 02:43:43 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:43 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.415s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:43 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Deleted volume successfully.
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-bd42ea39-6dcb-44d9-93f0-68de16127e05 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-846f16ec-6dde-4e4a-84ea-aef0a49ac60b-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:43 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:43 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.info
Apr 22 02:43:43 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:43 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.info" returned: 0 in 0.430s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:43 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.info is being set with open permissions: ugo+rw
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:43 devstack sudo[90118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.info
Apr 22 02:43:43 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-73cbce0c-23af-4465-8673-cf76c437490c-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-73cbce0c-23af-4465-8673-cf76c437490c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-73cbce0c-23af-4465-8673-cf76c437490c" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-73cbce0c-23af-4465-8673-cf76c437490c" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7cb0c6-25b7-4054-89e9-00e8e3d165b4]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:44 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c
Apr 22 02:43:44 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:44 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.info" returned: 0 in 0.411s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.873s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.917s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-731477723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392f3282-6eff-43c7-8212-109ea00ffeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:42Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Creating volume 392f3282-6eff-43c7-8212-109ea00ffeb7 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:44 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:44 devstack sudo[90123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7 1073741824
Apr 22 02:43:44 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:44 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-863ac608-1dc2-4f39-9e50-2b050e388011 tempest-VolumesSnapshotTestJSON-963446238 None] Create snapshot completed successfully
Apr 22 02:43:44 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:44 devstack sudo[90128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c
Apr 22 02:43:44 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:44 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7 1073741824" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:44 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7
Apr 22 02:43:44 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:44 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-73cbce0c-23af-4465-8673-cf76c437490c" returned: 0 in 0.412s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-73cbce0c-23af-4465-8673-cf76c437490c" released by "delete_volume" :: held 0.935s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:44 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Created reservations ['b916fdca-8d49-403b-aad3-66c45a6bf964', '188146a9-3cdd-45ce-be3d-d2f055812cee', 'fd13a2e8-faec-45d8-b61d-be2d22eb02fd', '972fa9cf-fc8b-4341-8ece-9c305290f044'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:45 devstack sudo[90136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:45 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-b1f303be-85ba-4708-8277-6c8424fec828-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-b1f303be-85ba-4708-8277-6c8424fec828-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "cinder-quobyte-b1f303be-85ba-4708-8277-6c8424fec828" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-b1f303be-85ba-4708-8277-6c8424fec828" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[788b441c-fcaf-4551-be84-9e11633f4cc1]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:45 devstack sudo[90138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828
Apr 22 02:43:45 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:45 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84efa164-c695-467a-937e-625d17125cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392f3282-6eff-43c7-8212-109ea00ffeb7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f46aae-84df-4b78-9fd1-6e0245cabdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume volume-392f3282-6eff-43c7-8212-109ea00ffeb7 (392f3282-6eff-43c7-8212-109ea00ffeb7): created successfully
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f46aae-84df-4b78-9fd1-6e0245cabdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (8a7c154b-b4e1-4b05-9fc2-b5a3a31b731e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:45 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e5cd7a42-7b49-4983-ae1b-eef0474a7c14 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created volume successfully.
Apr 22 02:43:45 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.476s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:45 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Deleted volume successfully.
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-7ca721ea-9308-4193-a53f-1deb4c86d458 tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-73cbce0c-23af-4465-8673-cf76c437490c-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:45 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828" returned: 0 in 0.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:45 devstack sudo[90146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828
Apr 22 02:43:45 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (d5313878-9294-43c9-ad86-60ee4f5c162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda008b2-6d36-4767-8083-b4edc524665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda008b2-6d36-4767-8083-b4edc524665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-602552423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557065cc-60c2-4613-84a2-5651a505b60a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5e1d893374fde9bc9182758b7e752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=48509d96-30db-41b5-aa9f-b2266fc8acf8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='1e56a88b820b406b88b48f70aaec7c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57f2231-1c11-48f0-9e19-1123c8cc4541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a57f2231-1c11-48f0-9e19-1123c8cc4541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ff8045-1eef-4495-9387-fd62dff0953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ff8045-1eef-4495-9387-fd62dff0953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '557065cc-60c2-4613-84a2-5651a505b60a', 'volume_name': 'volume-557065cc-60c2-4613-84a2-5651a505b60a', 'volume_size': 1, 'snapshot_id': '48509d96-30db-41b5-aa9f-b2266fc8acf8'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65215987-c44b-4031-ac3b-44992b905d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65215987-c44b-4031-ac3b-44992b905d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6eee5d4-3f7b-4d5d-87f3-80d9a9cca1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Volume 557065cc-60c2-4613-84a2-5651a505b60a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-557065cc-60c2-4613-84a2-5651a505b60a', 'volume_size': 1, 'snapshot_id': '48509d96-30db-41b5-aa9f-b2266fc8acf8'}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-48509d96-30db-41b5-aa9f-b2266fc8acf8-557065cc-60c2-4613-84a2-5651a505b60a" by "_create_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (b6772b13-8602-484d-b656-964a1e8daa33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b57b5c9-50f6-44e1-884f-fa21067c23d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-48509d96-30db-41b5-aa9f-b2266fc8acf8-557065cc-60c2-4613-84a2-5651a505b60a" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Creating volume 557065cc-60c2-4613-84a2-5651a505b60a from snapshot 48509d96-30db-41b5-aa9f-b2266fc8acf8 {{(pid=82678) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-557065cc-60c2-4613-84a2-5651a505b60a" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b57b5c9-50f6-44e1-884f-fa21067c23d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823149420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ecfb7d-e04d-40ab-abcf-07e2814e608c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a541a9fe-5eb1-4de9-8a1c-4b40fb3a1717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a541a9fe-5eb1-4de9-8a1c-4b40fb3a1717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1b1f25-529f-4537-bcc7-31be31e88cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1b1f25-529f-4537-bcc7-31be31e88cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ecfb7d-e04d-40ab-abcf-07e2814e608c', 'volume_name': 'volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00aef72-0237-4649-b007-ec2d38aab548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00aef72-0237-4649-b007-ec2d38aab548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160fdabf-cab5-408e-8e3a-a6db0ab3a69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:45 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume 28ecfb7d-e04d-40ab-abcf-07e2814e608c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c', 'volume_size': 1}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-557065cc-60c2-4613-84a2-5651a505b60a" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] snapshot: 48509d96-30db-41b5-aa9f-b2266fc8acf8, volume: 557065cc-60c2-4613-84a2-5651a505b60a,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (6045edd0-0467-40aa-9b01-f14bc59770a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9abc99-1b5e-4e40-8ff5-99127096a860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce36a069-9800-4184-bd56-68355a7097d8]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9abc99-1b5e-4e40-8ff5-99127096a860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816609842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ee7bc9-2d54-4382-a03c-b5e792071207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535a0a51-0c54-403e-94ad-aecfab730c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535a0a51-0c54-403e-94ad-aecfab730c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe6f567-c154-4212-8fde-20c5986f8055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe6f567-c154-4212-8fde-20c5986f8055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ee7bc9-2d54-4382-a03c-b5e792071207', 'volume_name': 'volume-01ee7bc9-2d54-4382-a03c-b5e792071207', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3bfd21-8c29-4d66-b4f8-062148014009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c3bfd21-8c29-4d66-b4f8-062148014009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1cffc0d-cccd-4ff4-a397-28dd8ccde659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume 01ee7bc9-2d54-4382-a03c-b5e792071207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ee7bc9-2d54-4382-a03c-b5e792071207', 'volume_size': 1}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:46 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8
Apr 22 02:43:46 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:46 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1f303be-85ba-4708-8277-6c8424fec828" returned: 0 in 0.517s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-quobyte-b1f303be-85ba-4708-8277-6c8424fec828" released by "delete_volume" :: held 1.084s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (b813e81b-42ad-4245-bbe3-e2db6414cddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719a090f-1eaa-4671-a8c6-a8c7f7bcad9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719a090f-1eaa-4671-a8c6-a8c7f7bcad9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527620081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0116d0ad-7ae5-4011-b6fe-56239b2255b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e9a0c4-ce23-4f9a-a8da-a84242f867eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e9a0c4-ce23-4f9a-a8da-a84242f867eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2063222-7d88-4991-924f-097ea409b14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2063222-7d88-4991-924f-097ea409b14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0116d0ad-7ae5-4011-b6fe-56239b2255b5', 'volume_name': 'volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0fab27-d1a5-4084-bd07-458bd6e7bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d0fab27-d1a5-4084-bd07-458bd6e7bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19617d20-67d9-4b1a-90b9-3d4ee48555f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume 0116d0ad-7ae5-4011-b6fe-56239b2255b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5', 'volume_size': 1}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Created reservations ['7a630999-3c84-4461-ab7f-d434f0e4e4a2', 'c2dfa609-ae41-4352-b1ca-df8d24584592', '5d33bb39-8e6d-47e3-bc2d-0aa7ac02ad3d', '58656d4c-1406-4bbb-93da-958e2e6bea6e'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (0e9fd617-e5a6-4756-abcd-f7bf5d06b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5cc359-d43f-4935-a2bc-0b38ef9ea8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5cc359-d43f-4935-a2bc-0b38ef9ea8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1216898344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb1ad68-9d3e-43ff-a886-6f4f385b3862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db460beb-d662-45b4-907a-58ae622c691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db460beb-d662-45b4-907a-58ae622c691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761a6fc7-2fb5-424d-9d06-7c08b3d8bc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761a6fc7-2fb5-424d-9d06-7c08b3d8bc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb1ad68-9d3e-43ff-a886-6f4f385b3862', 'volume_name': 'volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cddfa81-2c79-4a30-baee-fe4dbd66a2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cddfa81-2c79-4a30-baee-fe4dbd66a2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d5ddd6-f35b-419c-84f3-a0e0e2be1a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume 7fb1ad68-9d3e-43ff-a886-6f4f385b3862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862', 'volume_size': 1}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:46 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:46 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (e3eb20c7-e2c7-4432-bf93-fcc6fa0c52f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fdf80e-005d-4eec-bd08-70c2d3aa7b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fdf80e-005d-4eec-bd08-70c2d3aa7b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305741253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce74ef0-2ca2-467f-a5b9-29914562afc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:47Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a896b6-613a-477f-8020-c0c35688775d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a896b6-613a-477f-8020-c0c35688775d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43c6873-a453-4046-b796-da4a2bab0711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43c6873-a453-4046-b796-da4a2bab0711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce74ef0-2ca2-467f-a5b9-29914562afc7', 'volume_name': 'volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6553bfe5-6241-42b1-847c-a39ab0d63d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6553bfe5-6241-42b1-847c-a39ab0d63d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edd9b7a-b668-4612-b8c1-15d3e11420e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:46 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume 8ce74ef0-2ca2-467f-a5b9-29914562afc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7', 'volume_size': 1}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8" returned: 0 in 0.617s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2e3a530-763a-48c5-a204-8f67a525cb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc011341-e941-4d1b-9fb7-68374fef0282]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:46 devstack sudo[90156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c
Apr 22 02:43:46 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:46 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.436s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:46 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Deleted volume successfully.
Apr 22 02:43:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-68a1783f-3c7f-495b-bae3-b1d9279ac8bf tempest-VolumeDependencyTests-2013414134 None] Lock "cinder-b1f303be-85ba-4708-8277-6c8424fec828-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:47 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:47 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:43:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:47 devstack sudo[90162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a
Apr 22 02:43:47 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:49 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a" returned: 0 in 2.207s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:49 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c312cea-1617-4635-b6fe-68bee48b59e6]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:49 devstack sudo[90175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c
Apr 22 02:43:49 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:49 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c" returned: 0 in 0.587s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:49 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:43:49 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Converted 1024.00 MB image at 463.73 MB/s
Apr 22 02:43:49 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a is being set with open permissions: ugo+rw
Apr 22 02:43:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:49 devstack sudo[90180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a
Apr 22 02:43:49 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:50 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a" returned: 0 in 0.405s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-557065cc-60c2-4613-84a2-5651a505b60a" released by "_copy_volume_from_snapshot" :: held 4.375s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-48509d96-30db-41b5-aa9f-b2266fc8acf8-557065cc-60c2-4613-84a2-5651a505b60a" released by "_create_volume_from_snapshot" :: held 4.441s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.485s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.397s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823149420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ecfb7d-e04d-40ab-abcf-07e2814e608c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Creating volume 28ecfb7d-e04d-40ab-abcf-07e2814e608c {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:50 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:50 devstack sudo[90183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c 1073741824
Apr 22 02:43:50 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6eee5d4-3f7b-4d5d-87f3-80d9a9cca1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557065cc-60c2-4613-84a2-5651a505b60a', 'volume_size': 1, 'snapshot_id': '48509d96-30db-41b5-aa9f-b2266fc8acf8'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4d7407-46e0-4f53-8be8-8fb002476ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:50 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Volume volume-557065cc-60c2-4613-84a2-5651a505b60a (557065cc-60c2-4613-84a2-5651a505b60a): created successfully
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4d7407-46e0-4f53-8be8-8fb002476ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Flow 'volume_create_manager' (d5313878-9294-43c9-ad86-60ee4f5c162e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:50 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-38f0f5f5-04e9-4920-9b28-faa42d94cf56 tempest-VolumesSnapshotTestJSON-963446238 None] Created volume successfully.
Apr 22 02:43:50 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c 1073741824" returned: 0 in 0.479s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:50 devstack sudo[90188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c
Apr 22 02:43:50 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:51 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c" returned: 0 in 0.407s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.197s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816609842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ee7bc9-2d54-4382-a03c-b5e792071207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Creating volume 01ee7bc9-2d54-4382-a03c-b5e792071207 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:51 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160fdabf-cab5-408e-8e3a-a6db0ab3a69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57bce54-3405-4b2e-b1f9-d74b45aa6a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:51 devstack sudo[90191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207 1073741824
Apr 22 02:43:51 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-557065cc-60c2-4613-84a2-5651a505b60a-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:51 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c (28ecfb7d-e04d-40ab-abcf-07e2814e608c): created successfully
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57bce54-3405-4b2e-b1f9-d74b45aa6a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (b6772b13-8602-484d-b656-964a1e8daa33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-557065cc-60c2-4613-84a2-5651a505b60a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:51 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c46ec819-a45a-4897-9295-d37b41f3d8de tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created volume successfully.
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-557065cc-60c2-4613-84a2-5651a505b60a" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-557065cc-60c2-4613-84a2-5651a505b60a" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f891533-8ff3-4522-83d0-6cefeb809d9f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:51 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a
Apr 22 02:43:51 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:51 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207 1073741824" returned: 0 in 0.496s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:51 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207
Apr 22 02:43:51 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:51 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a" returned: 0 in 0.478s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:51 devstack sudo[90204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a
Apr 22 02:43:51 devstack sudo[90204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:52 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207" returned: 0 in 0.404s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.857s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527620081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0116d0ad-7ae5-4011-b6fe-56239b2255b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Creating volume 0116d0ad-7ae5-4011-b6fe-56239b2255b5 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:52 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1cffc0d-cccd-4ff4-a397-28dd8ccde659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ee7bc9-2d54-4382-a03c-b5e792071207', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04129d7-716b-444f-952a-4970d9c6c2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:52 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5 1073741824
Apr 22 02:43:52 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume volume-01ee7bc9-2d54-4382-a03c-b5e792071207 (01ee7bc9-2d54-4382-a03c-b5e792071207): created successfully
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04129d7-716b-444f-952a-4970d9c6c2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (6045edd0-0467-40aa-9b01-f14bc59770a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-7f2e05a1-5d04-4669-b069-bb027d487208 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created volume successfully.
Apr 22 02:43:52 devstack sudo[90204]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-557065cc-60c2-4613-84a2-5651a505b60a" returned: 0 in 0.419s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-557065cc-60c2-4613-84a2-5651a505b60a" released by "delete_volume" :: held 0.918s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Created reservations ['ae17c9e1-aceb-42e7-be9d-b1c9403df984', '7e5258fd-9b7f-4f02-8fea-4aec2951fac4', '47d6e974-1862-4163-b1b7-dc0d054e5472', 'fac0839a-5abf-4d16-a2e7-4a88d3808076'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:52 devstack sudo[90210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:52 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-48509d96-30db-41b5-aa9f-b2266fc8acf8-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-48509d96-30db-41b5-aa9f-b2266fc8acf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-c2e3a530-763a-48c5-a204-8f67a525cb0c" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-c2e3a530-763a-48c5-a204-8f67a525cb0c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-48509d96-30db-41b5-aa9f-b2266fc8acf8" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-48509d96-30db-41b5-aa9f-b2266fc8acf8" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Deleting offline snapshot 48509d96-30db-41b5-aa9f-b2266fc8acf8 of volume c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] snapshot_file for this snap is: volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d876e0c4-b9c7-4bfb-b777-5e1822cccde0]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:52 devstack sudo[90213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8
Apr 22 02:43:52 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:52 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5 1073741824" returned: 0 in 0.506s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:52 devstack sudo[90219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5
Apr 22 02:43:52 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:52 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.457s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Deleted volume successfully.
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aed8b5a9-fa96-48f2-b907-7674a98c55e2 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-557065cc-60c2-4613-84a2-5651a505b60a-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:52 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2e3a530-763a-48c5-a204-8f67a525cb0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bb0f3e-44eb-4ea3-9d7a-6c9d08bffb3a]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:53 devstack sudo[90224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c
Apr 22 02:43:53 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:53 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5" returned: 0 in 0.408s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.705s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1216898344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb1ad68-9d3e-43ff-a886-6f4f385b3862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:46Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Creating volume 7fb1ad68-9d3e-43ff-a886-6f4f385b3862 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:53 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19617d20-67d9-4b1a-90b9-3d4ee48555f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5c6863-06a3-4299-813b-5e6fde39566f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:53 devstack sudo[90227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862 1073741824
Apr 22 02:43:53 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:53 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5 (0116d0ad-7ae5-4011-b6fe-56239b2255b5): created successfully
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5c6863-06a3-4299-813b-5e6fde39566f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (b813e81b-42ad-4245-bbe3-e2db6414cddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:53 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-aaf631b5-bdd2-4a27-bef8-6325a4c1d285 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created volume successfully.
Apr 22 02:43:53 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c" returned: 0 in 0.496s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:53 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8
Apr 22 02:43:53 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:53 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862 1073741824" returned: 0 in 0.486s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:53 devstack sudo[90237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862
Apr 22 02:43:53 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:53 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8" returned: 0 in 0.453s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:53 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8
Apr 22 02:43:53 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:54 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862" returned: 0 in 0.408s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.450s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1305741253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce74ef0-2ca2-467f-a5b9-29914562afc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf07f0a822a4469914a0227f50a54c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:43:47Z,use_quota=True,user_id='8b919c89552c4990952b0f5ed14b6de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Creating volume 8ce74ef0-2ca2-467f-a5b9-29914562afc7 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:43:54 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d5ddd6-f35b-419c-84f3-a0e0e2be1a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2333dde5-d48a-4271-9fe9-7845bcc2dbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:54 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7 1073741824
Apr 22 02:43:54 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:54 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862 (7fb1ad68-9d3e-43ff-a886-6f4f385b3862): created successfully
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2333dde5-d48a-4271-9fe9-7845bcc2dbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (0e9fd617-e5a6-4756-abcd-f7bf5d06b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f254674b-c809-47ef-a069-e38bb7d8a980 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created volume successfully.
Apr 22 02:43:54 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c.48509d96-30db-41b5-aa9f-b2266fc8acf8" returned: 0 in 0.410s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-48509d96-30db-41b5-aa9f-b2266fc8acf8" released by "_delete_snapshot" :: held 1.927s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-c2e3a530-763a-48c5-a204-8f67a525cb0c" released by "delete_snapshot" :: held 1.937s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Created reservations ['de448ae0-3f7c-49b9-bee0-3e543976ba4b', '536c3a9e-f049-452b-af3e-63ca7d6483d7', '5041a872-ae91-452c-b9e0-37e0f745051d', '78a3e342-5306-40da-94c2-95eb5cd5c429'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Delete snapshot completed successfully.
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-082c3de1-51cf-46d3-87d6-362f93e07d89 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-48509d96-30db-41b5-aa9f-b2266fc8acf8-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:54 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7 1073741824" returned: 0 in 0.476s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-c2e3a530-763a-48c5-a204-8f67a525cb0c-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:54 devstack sudo[90251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7
Apr 22 02:43:54 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-c2e3a530-763a-48c5-a204-8f67a525cb0c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-c2e3a530-763a-48c5-a204-8f67a525cb0c" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-c2e3a530-763a-48c5-a204-8f67a525cb0c" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b90cb01-023d-4fb4-af42-6221844510bb]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:54 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c
Apr 22 02:43:54 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:54 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7" returned: 0 in 0.415s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edd9b7a-b668-4612-b8c1-15d3e11420e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:54 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992aff4e-f26c-40d9-8851-3e27cb6d236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:43:55 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Volume volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7 (8ce74ef0-2ca2-467f-a5b9-29914562afc7): created successfully
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992aff4e-f26c-40d9-8851-3e27cb6d236b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Flow 'volume_create_manager' (e3eb20c7-e2c7-4432-bf93-fcc6fa0c52f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:43:55 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-e649ae9b-c84b-49d7-b5f6-8dd0d4405efc tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created volume successfully.
Apr 22 02:43:55 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c" returned: 0 in 0.468s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:55 devstack sudo[90259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c
Apr 22 02:43:55 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-8ce74ef0-2ca2-467f-a5b9-29914562afc7-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-8ce74ef0-2ca2-467f-a5b9-29914562afc7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-quobyte-8ce74ef0-2ca2-467f-a5b9-29914562afc7" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-8ce74ef0-2ca2-467f-a5b9-29914562afc7" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c613b228-c306-4376-9c87-ab53ce804370]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:55 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7
Apr 22 02:43:55 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:55 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c2e3a530-763a-48c5-a204-8f67a525cb0c" returned: 0 in 0.429s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-c2e3a530-763a-48c5-a204-8f67a525cb0c" released by "delete_volume" :: held 0.924s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Created reservations ['dd09f082-282e-46c9-b5b7-fe0775795c6e', '4089650c-e1f0-4f32-841d-17565544af6d', 'e644240c-f2f0-4e15-99ff-a2f83405dadc', 'dfdf9d66-cfba-4c67-82de-da1d41671c5c'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:55 devstack sudo[90264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:55 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-568053af-0281-4659-896a-7a36dfb090a3-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-568053af-0281-4659-896a-7a36dfb090a3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "cinder-quobyte-568053af-0281-4659-896a-7a36dfb090a3" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-568053af-0281-4659-896a-7a36dfb090a3" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c853941-ae84-4e09-9a34-066f62806bcc]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:55 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7" returned: 0 in 0.516s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:55 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7
Apr 22 02:43:55 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:55 devstack sudo[90269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3
Apr 22 02:43:55 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:56 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.454s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:56 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Deleted volume successfully.
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-896d2c89-ba33-4d0f-a59a-e89317feb269 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-c2e3a530-763a-48c5-a204-8f67a525cb0c-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:56 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3" returned: 0 in 0.461s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:56 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-8ce74ef0-2ca2-467f-a5b9-29914562afc7" returned: 0 in 0.434s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-8ce74ef0-2ca2-467f-a5b9-29914562afc7" released by "delete_volume" :: held 0.974s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:56 devstack sudo[90278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3
Apr 22 02:43:56 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created reservations ['81b4cfc1-3e26-4558-97da-2d32296cb012', 'f3b862d3-e44f-46f8-8b73-be2e992ae182', '0d7c4424-5539-4cc9-8c2c-752c47eedfff', 'd0576891-fb98-4805-b608-98a8ead56c75'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:56 devstack sudo[90280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:56 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-7fb1ad68-9d3e-43ff-a886-6f4f385b3862-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-7fb1ad68-9d3e-43ff-a886-6f4f385b3862-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-quobyte-7fb1ad68-9d3e-43ff-a886-6f4f385b3862" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-7fb1ad68-9d3e-43ff-a886-6f4f385b3862" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a0c8f-6782-44fb-86f9-074c095ef1cd]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:56 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862
Apr 22 02:43:56 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:56 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-568053af-0281-4659-896a-7a36dfb090a3" returned: 0 in 0.451s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-quobyte-568053af-0281-4659-896a-7a36dfb090a3" released by "delete_volume" :: held 0.948s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Created reservations ['00008668-d968-4e84-965b-163c8e603244', 'c35eee0c-b723-4ea5-9336-cf4a9bce0483', '3523d106-ad12-4a1a-a2bc-e32ecea27a65', 'db2bd036-e72f-4542-846b-796cadaa6713'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:56 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.452s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:56 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Deleted volume successfully.
Apr 22 02:43:56 devstack sudo[90286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:56 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-f7c322b1-c83d-4b51-870f-407ec4403b6c tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-8ce74ef0-2ca2-467f-a5b9-29914562afc7-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:57 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862" returned: 0 in 0.529s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:57 devstack sudo[90291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862
Apr 22 02:43:57 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:57 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Deleted volume successfully.
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1114b150-591b-477d-868a-5ab0a6978839 tempest-VolumesSnapshotTestJSON-963446238 None] Lock "cinder-568053af-0281-4659-896a-7a36dfb090a3-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:57 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7fb1ad68-9d3e-43ff-a886-6f4f385b3862" returned: 0 in 0.473s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-7fb1ad68-9d3e-43ff-a886-6f4f385b3862" released by "delete_volume" :: held 1.026s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:DELETE=29,cinder:SELECT=227,cinder:UPDATE=297,cinder:INSERT=65 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created reservations ['2c93f187-0736-4d87-80a8-a5b7f620aff4', '1d7dc3e7-0e0c-4cd7-b516-0204f37a95a2', '75f37f2c-4391-4ed8-8a11-26cdafa8da40', '6aa0fbba-61fe-48ab-801d-1be60235ccda'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:57 devstack sudo[90296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:57 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:58 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.434s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:43:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Deleted volume successfully.
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-cb931020-7697-4376-8f31-2a8fe2d049b3 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-7fb1ad68-9d3e-43ff-a886-6f4f385b3862-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-0116d0ad-7ae5-4011-b6fe-56239b2255b5-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-0116d0ad-7ae5-4011-b6fe-56239b2255b5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-quobyte-0116d0ad-7ae5-4011-b6fe-56239b2255b5" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-0116d0ad-7ae5-4011-b6fe-56239b2255b5" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebbd031-3ed5-4008-a77a-b208a7a7d745]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:43:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:58 devstack sudo[90300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5
Apr 22 02:43:58 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:59 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5" returned: 0 in 0.519s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:59 devstack sudo[90305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5
Apr 22 02:43:59 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:43:59 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-0116d0ad-7ae5-4011-b6fe-56239b2255b5" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-0116d0ad-7ae5-4011-b6fe-56239b2255b5" released by "delete_volume" :: held 1.043s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created reservations ['bf69c49b-6d88-4f33-a5df-d3d90b4d7f2a', 'fe59be28-a557-445e-aba6-8cc76885d2f5', 'b7f13d59-5f0e-455e-8ea4-f8f3380aa091', '9f250444-3df2-4684-9cbf-5d6d7f9774fb'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:43:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:43:59 devstack sudo[90309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:43:59 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:00 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:00 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Deleted volume successfully.
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-270e4585-50a8-498d-be63-d3e0bfd4215f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-0116d0ad-7ae5-4011-b6fe-56239b2255b5-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-01ee7bc9-2d54-4382-a03c-b5e792071207-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-01ee7bc9-2d54-4382-a03c-b5e792071207-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-quobyte-01ee7bc9-2d54-4382-a03c-b5e792071207" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-01ee7bc9-2d54-4382-a03c-b5e792071207" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d13050-934b-4bbf-9f46-5adfb9f0ec59]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:00 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207
Apr 22 02:44:00 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:01 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207" returned: 0 in 0.509s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:01 devstack sudo[90317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207
Apr 22 02:44:01 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:01 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01ee7bc9-2d54-4382-a03c-b5e792071207" returned: 0 in 0.429s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-01ee7bc9-2d54-4382-a03c-b5e792071207" released by "delete_volume" :: held 0.963s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created reservations ['84873cd8-27ac-4663-957c-0cc296192b10', 'd72aa659-6420-4bfc-bab2-05c3cfddf0ff', '62d73cc6-c7f1-428b-8328-0d71b8b0ba7c', 'eb991c44-8958-4d43-bd2a-30aa4fb18eb6'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:01 devstack sudo[90321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:01 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-28ecfb7d-e04d-40ab-abcf-07e2814e608c-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-28ecfb7d-e04d-40ab-abcf-07e2814e608c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-quobyte-28ecfb7d-e04d-40ab-abcf-07e2814e608c" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-28ecfb7d-e04d-40ab-abcf-07e2814e608c" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[254eb16f-2919-4004-abee-7f11f45c2dd0]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:02 devstack sudo[90323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c
Apr 22 02:44:02 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:02 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.447s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:02 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:02 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Deleted volume successfully.
Apr 22 02:44:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-18a1efda-7a0e-48fa-8af2-5ac419ed0102 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-01ee7bc9-2d54-4382-a03c-b5e792071207-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:02 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:02 devstack sudo[90329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c
Apr 22 02:44:02 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:02 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-28ecfb7d-e04d-40ab-abcf-07e2814e608c" returned: 0 in 0.445s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:02 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-28ecfb7d-e04d-40ab-abcf-07e2814e608c" released by "delete_volume" :: held 0.978s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:02 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created reservations ['d316e779-b8cd-432e-b185-0cc2ac2055a3', '8deeb586-ce37-4c99-b34f-33749fb2410f', 'd3fa1924-dcd4-4b4f-8a2a-0674528c074c', '52f68543-28bb-480c-8203-7ac99785ca0f'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:03 devstack sudo[90332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:03 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:03 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.456s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Deleted volume successfully.
Apr 22 02:44:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ea6fdc72-7dc2-4bd4-8b39-5d34ec7e02f5 tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-28ecfb7d-e04d-40ab-abcf-07e2814e608c-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-392f3282-6eff-43c7-8212-109ea00ffeb7-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-392f3282-6eff-43c7-8212-109ea00ffeb7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "cinder-quobyte-392f3282-6eff-43c7-8212-109ea00ffeb7" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-392f3282-6eff-43c7-8212-109ea00ffeb7" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:04 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7098d701-6930-4d67-9beb-a8299e305098]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:04 devstack sudo[90335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7
Apr 22 02:44:04 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:04 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7" returned: 0 in 0.557s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:04 devstack sudo[90340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7
Apr 22 02:44:04 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:05 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-392f3282-6eff-43c7-8212-109ea00ffeb7" returned: 0 in 0.497s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-quobyte-392f3282-6eff-43c7-8212-109ea00ffeb7" released by "delete_volume" :: held 1.082s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Created reservations ['6d578584-3bc8-4585-a640-72976fb83033', '4bae9c31-e0d5-4989-a452-29b3d2ed22c3', '2d65c471-b843-4d98-9eb1-505d4f56fe40', 'f35b5476-0bf8-4fbe-a795-476f8287aa87'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:05 devstack sudo[90343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:05 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:05 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.405s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:05 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Deleted volume successfully.
Apr 22 02:44:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-88e4c7f4-87e2-4465-b40b-2094658a972f tempest-CreateVolumesFromSourceVolumeTest-673357626 None] Lock "cinder-392f3282-6eff-43c7-8212-109ea00ffeb7-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Flow 'volume_create_manager' (366c05c8-48b2-41b8-a8cc-947f1581fac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a32951-14bb-4567-8fe4-bdb07efaddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a32951-14bb-4567-8fe4-bdb07efaddb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-516281068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42417ffd-cdfd-42b7-be60-fc228f750e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc023dc52ff644bebf00ce94f1290082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:14Z,use_quota=True,user_id='6c3de6cd7e5f48749eca8089ef9445ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c505dc0-ae15-483e-a243-1e97b3cf4b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c505dc0-ae15-483e-a243-1e97b3cf4b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95be045b-542a-4075-8717-998f001ced3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95be045b-542a-4075-8717-998f001ced3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42417ffd-cdfd-42b7-be60-fc228f750e7e', 'volume_name': 'volume-42417ffd-cdfd-42b7-be60-fc228f750e7e', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d6e96c-35e8-4ad9-b87d-8d657989469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d6e96c-35e8-4ad9-b87d-8d657989469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb34ea2-9f5d-4087-afb0-038c268dc8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:14 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Volume 42417ffd-cdfd-42b7-be60-fc228f750e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42417ffd-cdfd-42b7-be60-fc228f750e7e', 'volume_size': 1}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-516281068',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42417ffd-cdfd-42b7-be60-fc228f750e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc023dc52ff644bebf00ce94f1290082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:14Z,use_quota=True,user_id='6c3de6cd7e5f48749eca8089ef9445ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Creating volume 42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:14 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:14 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e 1073741824
Apr 22 02:44:14 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:14 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e 1073741824" returned: 0 in 0.533s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:14 devstack sudo[90360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e
Apr 22 02:44:14 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:15 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e" returned: 0 in 0.400s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb34ea2-9f5d-4087-afb0-038c268dc8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42417ffd-cdfd-42b7-be60-fc228f750e7e', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fe1419-0ffc-4c57-82ac-3d5105e6c51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:15 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Volume volume-42417ffd-cdfd-42b7-be60-fc228f750e7e (42417ffd-cdfd-42b7-be60-fc228f750e7e): created successfully
Apr 22 02:44:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fe1419-0ffc-4c57-82ac-3d5105e6c51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Flow 'volume_create_manager' (366c05c8-48b2-41b8-a8cc-947f1581fac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:15 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d19b6129-be65-4e47-9a11-aa76f52889b0 tempest-SnapshotDependencyTests-626946320 None] Created volume successfully.
Apr 22 02:44:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:16 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Creating offline snapshot 58090aa0-68d7-4388-a055-6c635d1e9b64 of volume 42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:44:16 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2450be-166e-456b-ba56-06ca72147749]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:16 devstack sudo[90363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e
Apr 22 02:44:16 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:16 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e" returned: 0 in 0.470s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:16 devstack sudo[90368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 1G
Apr 22 02:44:16 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:17 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 1G" returned: 0 in 0.484s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42417ffd-cdfd-42b7-be60-fc228f750e7e -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:17 devstack sudo[90373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42417ffd-cdfd-42b7-be60-fc228f750e7e -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64
Apr 22 02:44:17 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:17 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42417ffd-cdfd-42b7-be60-fc228f750e7e -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64" returned: 0 in 0.428s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:17 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 is being set with open permissions: ugo+rw
Apr 22 02:44:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:17 devstack sudo[90378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64
Apr 22 02:44:17 devstack sudo[90378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:18 devstack sudo[90378]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64" returned: 0 in 0.393s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:18 devstack sudo[90381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.info
Apr 22 02:44:18 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:18 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.info" returned: 0 in 0.424s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:18 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.info is being set with open permissions: ugo+rw
Apr 22 02:44:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:18 devstack sudo[90384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.info
Apr 22 02:44:18 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:18 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.info" returned: 0 in 0.399s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.654s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:19 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c0fece49-a4aa-4f78-a215-341adf207ff0 tempest-SnapshotDependencyTests-626946320 None] Create snapshot completed successfully
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Flow 'volume_create_manager' (4ee0366e-e88b-4a28-a8e2-9d562e2ee503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77682a8f-292c-4a5d-951e-503c565140de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77682a8f-292c-4a5d-951e-503c565140de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8111ac1-4749-4335-9e12-375f322e8f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc023dc52ff644bebf00ce94f1290082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=58090aa0-68d7-4388-a055-6c635d1e9b64,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:20Z,use_quota=True,user_id='6c3de6cd7e5f48749eca8089ef9445ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cb169f-ec00-4e2d-9b2e-6c7363f61f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cb169f-ec00-4e2d-9b2e-6c7363f61f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa94446a-0f63-425f-92e0-aacd12d3f827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa94446a-0f63-425f-92e0-aacd12d3f827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8111ac1-4749-4335-9e12-375f322e8f68', 'volume_name': 'volume-e8111ac1-4749-4335-9e12-375f322e8f68', 'volume_size': 1, 'snapshot_id': '58090aa0-68d7-4388-a055-6c635d1e9b64'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09581b91-dd22-48ea-b943-5f5b8a6227c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09581b91-dd22-48ea-b943-5f5b8a6227c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a0d9bc-857c-4410-befe-5465688817aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:19 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Volume e8111ac1-4749-4335-9e12-375f322e8f68: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8111ac1-4749-4335-9e12-375f322e8f68', 'volume_size': 1, 'snapshot_id': '58090aa0-68d7-4388-a055-6c635d1e9b64'}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-quobyte-58090aa0-68d7-4388-a055-6c635d1e9b64-e8111ac1-4749-4335-9e12-375f322e8f68" by "_create_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-58090aa0-68d7-4388-a055-6c635d1e9b64-e8111ac1-4749-4335-9e12-375f322e8f68" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Creating volume e8111ac1-4749-4335-9e12-375f322e8f68 from snapshot 58090aa0-68d7-4388-a055-6c635d1e9b64 {{(pid=82678) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-quobyte-e8111ac1-4749-4335-9e12-375f322e8f68" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-e8111ac1-4749-4335-9e12-375f322e8f68" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] snapshot: 58090aa0-68d7-4388-a055-6c635d1e9b64, volume: e8111ac1-4749-4335-9e12-375f322e8f68,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e40e9b-c59c-41e9-b964-20e566d7013c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:20 devstack sudo[90421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64
Apr 22 02:44:20 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:20 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64" returned: 0 in 0.456s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42417ffd-cdfd-42b7-be60-fc228f750e7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[6563bc6d-40c4-4164-b246-99c24b73d227]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:20 devstack sudo[90426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e
Apr 22 02:44:20 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:20 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68 not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:44:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:20 devstack sudo[90431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68
Apr 22 02:44:20 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:22 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68" returned: 0 in 1.910s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93da2e2-7378-44b1-abc1-df893f906ba3]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:22 devstack sudo[90444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e
Apr 22 02:44:22 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:23 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e" returned: 0 in 0.595s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:44:23 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Converted 1024.00 MB image at 535.68 MB/s
Apr 22 02:44:23 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68 is being set with open permissions: ugo+rw
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:23 devstack sudo[90449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68
Apr 22 02:44:23 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:23 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68" returned: 0 in 0.410s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-e8111ac1-4749-4335-9e12-375f322e8f68" released by "_copy_volume_from_snapshot" :: held 3.918s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-58090aa0-68d7-4388-a055-6c635d1e9b64-e8111ac1-4749-4335-9e12-375f322e8f68" released by "_create_volume_from_snapshot" :: held 3.932s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.940s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a0d9bc-857c-4410-befe-5465688817aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8111ac1-4749-4335-9e12-375f322e8f68', 'volume_size': 1, 'snapshot_id': '58090aa0-68d7-4388-a055-6c635d1e9b64'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828d0664-5187-4f3e-b224-059be32b87cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:23 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Volume volume-e8111ac1-4749-4335-9e12-375f322e8f68 (e8111ac1-4749-4335-9e12-375f322e8f68): created successfully
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828d0664-5187-4f3e-b224-059be32b87cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:23 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Flow 'volume_create_manager' (4ee0366e-e88b-4a28-a8e2-9d562e2ee503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:23 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0f3090f6-441b-44d3-ac16-d7c331008568 tempest-SnapshotDependencyTests-626946320 None] Created volume successfully.
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-58090aa0-68d7-4388-a055-6c635d1e9b64-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-58090aa0-68d7-4388-a055-6c635d1e9b64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-quobyte-42417ffd-cdfd-42b7-be60-fc228f750e7e" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-42417ffd-cdfd-42b7-be60-fc228f750e7e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-quobyte-58090aa0-68d7-4388-a055-6c635d1e9b64" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-58090aa0-68d7-4388-a055-6c635d1e9b64" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Deleting offline snapshot 58090aa0-68d7-4388-a055-6c635d1e9b64 of volume 42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] snapshot_file for this snap is: volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e700f22-ad47-4c33-8daf-5ddf403b8a04]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:24 devstack sudo[90452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64
Apr 22 02:44:24 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:24 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64" returned: 0 in 0.467s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42417ffd-cdfd-42b7-be60-fc228f750e7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8299ad-4386-48dc-a836-65c0879b9dff]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:24 devstack sudo[90457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e
Apr 22 02:44:24 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:25 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e" returned: 0 in 0.460s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:25 devstack sudo[90462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64
Apr 22 02:44:25 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:25 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:25 devstack sudo[90467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64
Apr 22 02:44:25 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:25 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e.58090aa0-68d7-4388-a055-6c635d1e9b64" returned: 0 in 0.414s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-58090aa0-68d7-4388-a055-6c635d1e9b64" released by "_delete_snapshot" :: held 1.836s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-42417ffd-cdfd-42b7-be60-fc228f750e7e" released by "delete_snapshot" :: held 1.847s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:25 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Created reservations ['831f64ab-373d-4ff6-947a-164bfcc559af', '94222a06-10b2-405d-8711-c22c590d44b8', '5f96819d-025d-4919-817d-9c683318c1a2', 'c3c2cfd5-4a6c-47c8-ad93-cf1c9535f8f9'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:26 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Delete snapshot completed successfully.
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-43fc550b-4eaf-4860-8e04-e7e77b8ada26 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-58090aa0-68d7-4388-a055-6c635d1e9b64-delete_snapshot" released by "delete_snapshot" :: held 1.921s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-42417ffd-cdfd-42b7-be60-fc228f750e7e-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-42417ffd-cdfd-42b7-be60-fc228f750e7e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-quobyte-42417ffd-cdfd-42b7-be60-fc228f750e7e" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-42417ffd-cdfd-42b7-be60-fc228f750e7e" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be93e5-80f7-4048-9a1b-e3298c14bd8c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:26 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e
Apr 22 02:44:26 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:26 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e" returned: 0 in 0.487s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:26 devstack sudo[90475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e
Apr 22 02:44:26 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:27 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-42417ffd-cdfd-42b7-be60-fc228f750e7e" returned: 0 in 0.403s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-42417ffd-cdfd-42b7-be60-fc228f750e7e" released by "delete_volume" :: held 0.926s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Created reservations ['168320dc-d509-4c17-a1ef-5da79598312f', '5ffe233d-13bd-4e87-9af6-31441c24e9fa', '44729b25-418c-4f70-a89a-29a07fc532c0', 'b9ac0a62-ec28-4746-924e-9becc825c04b'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:27 devstack sudo[90478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:27 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-e8111ac1-4749-4335-9e12-375f322e8f68-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-e8111ac1-4749-4335-9e12-375f322e8f68-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "cinder-quobyte-e8111ac1-4749-4335-9e12-375f322e8f68" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-e8111ac1-4749-4335-9e12-375f322e8f68" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ba05db-73a4-412e-a7a2-5703a6d3b068]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:27 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68
Apr 22 02:44:27 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:27 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.443s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:27 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Deleted volume successfully.
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6984e42b-f8c4-4a7b-b8d8-249cff8ac3b6 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-42417ffd-cdfd-42b7-be60-fc228f750e7e-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:27 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68" returned: 0 in 0.474s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:27 devstack sudo[90486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68
Apr 22 02:44:27 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:28 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e8111ac1-4749-4335-9e12-375f322e8f68" returned: 0 in 0.400s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-quobyte-e8111ac1-4749-4335-9e12-375f322e8f68" released by "delete_volume" :: held 0.899s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Created reservations ['3b13c24c-e15b-4b71-9653-51037edfa481', '07d84cc0-92ca-4f1a-8e45-5e1f7fbb7be1', '594bd036-1ae7-4eb4-bd8d-82771ae5ccef', '5f88b2eb-79e5-4f3c-b665-fb68b09c13fe'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:28 devstack sudo[90489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:28 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:28 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.451s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:28 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Deleted volume successfully.
Apr 22 02:44:28 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-706ecb0e-494a-46e8-b6b0-65e526fa0df5 tempest-SnapshotDependencyTests-626946320 None] Lock "cinder-e8111ac1-4749-4335-9e12-375f322e8f68-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:31 devstack sudo[90494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:31 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:31 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:38 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=126,cinder:INSERT=51,cinder:UPDATE=204,cinder:DELETE=17 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:44:38 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=57,cinder:INSERT=15,cinder:UPDATE=71,cinder:DELETE=4 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Flow 'volume_create_manager' (cef75571-bc16-4bbd-8a93-c141bd804b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb726b40-5f0d-4d1a-8b7e-c03f32cb35ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb726b40-5f0d-4d1a-8b7e-c03f32cb35ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c873bc60-6525-4d3c-b6d5-232f452e0288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40bd252704f34ac69fdd8b62dce627de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:40Z,use_quota=True,user_id='f070b13a060e422db7e811b3145e9189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef45c51-7998-4826-a182-10d028d6d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef45c51-7998-4826-a182-10d028d6d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3e406a-80b9-4b7e-9bf4-e3fd2dc81f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3e406a-80b9-4b7e-9bf4-e3fd2dc81f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c873bc60-6525-4d3c-b6d5-232f452e0288', 'volume_name': 'volume-c873bc60-6525-4d3c-b6d5-232f452e0288', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabab131-546b-498c-9c64-58e45f7a0893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabab131-546b-498c-9c64-58e45f7a0893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1df1b4-5d07-4334-a2ab-c5849a78fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Volume c873bc60-6525-4d3c-b6d5-232f452e0288: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c873bc60-6525-4d3c-b6d5-232f452e0288', 'volume_size': 1}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c873bc60-6525-4d3c-b6d5-232f452e0288,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40bd252704f34ac69fdd8b62dce627de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:40Z,use_quota=True,user_id='f070b13a060e422db7e811b3145e9189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Creating volume c873bc60-6525-4d3c-b6d5-232f452e0288 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:40 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:40 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288 1073741824
Apr 22 02:44:40 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (14e994ec-d408-4e85-a9bb-88a09186113d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b35cce-5435-4428-bc63-4c67e4c21846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b35cce-5435-4428-bc63-4c67e4c21846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-110549366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424567c4-2b08-4500-a49a-cbeae90bdb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:40Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8302028a-d9c2-4a58-8c20-5db7fc4d0d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8302028a-d9c2-4a58-8c20-5db7fc4d0d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1378c788-f53e-46c5-9845-ed92222d01dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1378c788-f53e-46c5-9845-ed92222d01dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '424567c4-2b08-4500-a49a-cbeae90bdb29', 'volume_name': 'volume-424567c4-2b08-4500-a49a-cbeae90bdb29', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc74ae00-f24d-471e-a37b-6a39624d41f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc74ae00-f24d-471e-a37b-6a39624d41f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad7e33f-152d-41ed-95d0-a54948c46912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Volume 424567c4-2b08-4500-a49a-cbeae90bdb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-424567c4-2b08-4500-a49a-cbeae90bdb29', 'volume_size': 1}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (ce4da569-68fe-4134-987f-518b7d85680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88acd75-68ad-41e2-9fe0-0011476b88de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88acd75-68ad-41e2-9fe0-0011476b88de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425513414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79edae19-61dc-43e9-951d-045305601e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:40Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674050ae-cdb8-4e77-9b67-962286fffe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674050ae-cdb8-4e77-9b67-962286fffe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60657f7-d6ff-4012-98c7-4132d7263727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60657f7-d6ff-4012-98c7-4132d7263727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79edae19-61dc-43e9-951d-045305601e6a', 'volume_name': 'volume-79edae19-61dc-43e9-951d-045305601e6a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebbbe5b-268e-46f2-bd03-530b1e34626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebbbe5b-268e-46f2-bd03-530b1e34626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e14d41-d4d9-482d-81cc-6b050724bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume 79edae19-61dc-43e9-951d-045305601e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79edae19-61dc-43e9-951d-045305601e6a', 'volume_size': 1}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Flow 'volume_create_manager' (63583710-aff0-40c0-af13-8390d1050252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bd0f26-a19d-4c74-9dcc-b3027245c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bd0f26-a19d-4c74-9dcc-b3027245c16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1537724529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4626de-6d56-4696-a02c-a482af6f12c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e2e4c2cc2245bea4a633dd6c1d1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='eef4e2e6621744dab9b57460be338040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56604698-a18d-4d13-bfad-b707693a84b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56604698-a18d-4d13-bfad-b707693a84b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d60676c-15f9-437a-93ee-e32e34761fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d60676c-15f9-437a-93ee-e32e34761fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae4626de-6d56-4696-a02c-a482af6f12c0', 'volume_name': 'volume-ae4626de-6d56-4696-a02c-a482af6f12c0', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd89881-3f32-4a03-b1d8-a7e813f84d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd89881-3f32-4a03-b1d8-a7e813f84d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de499228-6802-41e7-bff8-fdc54bdfe6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Volume ae4626de-6d56-4696-a02c-a482af6f12c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae4626de-6d56-4696-a02c-a482af6f12c0', 'volume_size': 1}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (6db16ef7-9fe7-484a-9b47-2c31352b32c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe2cc33-6612-412a-aa65-21d9fe46fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe2cc33-6612-412a-aa65-21d9fe46fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316395976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7fa6d-926b-45b2-b6e5-acb9017f2b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb24d7c1-07bf-4b66-b787-2848934419c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb24d7c1-07bf-4b66-b787-2848934419c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3aeb61e-c44b-4e6d-bd7e-2c98a22fbb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3aeb61e-c44b-4e6d-bd7e-2c98a22fbb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b7fa6d-926b-45b2-b6e5-acb9017f2b0c', 'volume_name': 'volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838d9d7a-46bc-45ac-b607-15bee056c2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838d9d7a-46bc-45ac-b607-15bee056c2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34516330-4263-4f2a-87de-194a3777d560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:40 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Volume 53b7fa6d-926b-45b2-b6e5-acb9017f2b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c', 'volume_size': 1}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:40 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288 1073741824" returned: 0 in 0.604s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (595cd676-609c-42e7-8c97-eb891b4d202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:40 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6efc1f-be88-4751-97c1-16612b6596ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a6efc1f-be88-4751-97c1-16612b6596ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633952717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5d088d-fe76-47e6-9dd5-de84af6135cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37c84fe-ea74-42aa-a403-f3b4c9dba74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d37c84fe-ea74-42aa-a403-f3b4c9dba74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c7ff50-3454-4917-aabb-f201effb8cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c7ff50-3454-4917-aabb-f201effb8cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d5d088d-fe76-47e6-9dd5-de84af6135cd', 'volume_name': 'volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9ac7d6-6266-4502-b996-22aa8cb0db01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9ac7d6-6266-4502-b996-22aa8cb0db01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987622a7-e03e-4519-a461-ab19922b2f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Volume 7d5d088d-fe76-47e6-9dd5-de84af6135cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd', 'volume_size': 1}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:41 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288
Apr 22 02:44:41 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (15d76ffe-9c01-42e2-a859-0b69752c9587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dadf90-13f3-45ee-b3e9-4fa502b5948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5dadf90-13f3-45ee-b3e9-4fa502b5948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-786516876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669ceb5f-5a90-4438-b250-155f775984c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ae0197-342b-4871-b0bc-044e6900a739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ae0197-342b-4871-b0bc-044e6900a739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4766e2-aa1c-4f51-9c30-681a5fac6692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4766e2-aa1c-4f51-9c30-681a5fac6692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669ceb5f-5a90-4438-b250-155f775984c3', 'volume_name': 'volume-669ceb5f-5a90-4438-b250-155f775984c3', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8956430c-ae3b-46bd-9853-72f51a24e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8956430c-ae3b-46bd-9853-72f51a24e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e80aa76-bfed-43bc-8d19-c754f912b383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Volume 669ceb5f-5a90-4438-b250-155f775984c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669ceb5f-5a90-4438-b250-155f775984c3', 'volume_size': 1}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (7e3394ff-99aa-4fb8-917e-264c3cc9bd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036a0077-961b-4037-ad2c-cd22532e6cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036a0077-961b-4037-ad2c-cd22532e6cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762218281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd399cb-5d25-479c-84be-eb4ed1ec6bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cb0ffa-2572-489d-b82d-ec8863346cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6cb0ffa-2572-489d-b82d-ec8863346cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4589cc-4b99-4b12-9fb5-771a7c94aab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4589cc-4b99-4b12-9fb5-771a7c94aab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dd399cb-5d25-479c-84be-eb4ed1ec6bfa', 'volume_name': 'volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed124028-a612-4839-adce-11c0468311f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed124028-a612-4839-adce-11c0468311f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93ab5b7-05d0-4fe3-8201-a18b108d45b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Volume 3dd399cb-5d25-479c-84be-eb4ed1ec6bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa', 'volume_size': 1}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:41 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288" returned: 0 in 0.469s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-110549366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=424567c4-2b08-4500-a49a-cbeae90bdb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:40Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Creating volume 424567c4-2b08-4500-a49a-cbeae90bdb29 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:41 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1df1b4-5d07-4334-a2ab-c5849a78fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c873bc60-6525-4d3c-b6d5-232f452e0288', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29 1073741824
Apr 22 02:44:41 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6e7e0a-f30d-4690-bf87-e634d20009e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:41 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Volume volume-c873bc60-6525-4d3c-b6d5-232f452e0288 (c873bc60-6525-4d3c-b6d5-232f452e0288): created successfully
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6e7e0a-f30d-4690-bf87-e634d20009e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:41 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Flow 'volume_create_manager' (cef75571-bc16-4bbd-8a93-c141bd804b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:41 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8ad8f267-97cb-4dd4-a2d5-2b55b8df7c4d tempest-CinderUnicodeTest-364926599 None] Created volume successfully.
Apr 22 02:44:42 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29 1073741824" returned: 0 in 0.490s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:42 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29
Apr 22 02:44:42 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:42 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29" returned: 0 in 0.410s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.906s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-425513414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79edae19-61dc-43e9-951d-045305601e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:40Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Creating volume 79edae19-61dc-43e9-951d-045305601e6a {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:42 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad7e33f-152d-41ed-95d0-a54948c46912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424567c4-2b08-4500-a49a-cbeae90bdb29', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8ce482-f26a-4051-9d14-739c2f418f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:42 devstack sudo[90557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a 1073741824
Apr 22 02:44:42 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:42 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Volume volume-424567c4-2b08-4500-a49a-cbeae90bdb29 (424567c4-2b08-4500-a49a-cbeae90bdb29): created successfully
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8ce482-f26a-4051-9d14-739c2f418f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (14e994ec-d408-4e85-a9bb-88a09186113d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:42 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f17f363e-becb-495f-94e1-9c8fc0af5426 tempest-CreateVolumesFromImageTest-1777556079 None] Created volume successfully.
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Flow 'volume_create_manager' (86126914-f4ce-4b7a-9f6f-75923935920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e623f7-7623-41bd-8206-9b03f179b4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e623f7-7623-41bd-8206-9b03f179b4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1410154162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e18ae59-5276-4ce1-b1f5-254ac8abe9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40bd252704f34ac69fdd8b62dce627de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:43Z,use_quota=True,user_id='f070b13a060e422db7e811b3145e9189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19567177-b9cf-480f-873a-4d2826f4e2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19567177-b9cf-480f-873a-4d2826f4e2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade1bbd4-651b-44ee-96f2-d515a4f63a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade1bbd4-651b-44ee-96f2-d515a4f63a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e18ae59-5276-4ce1-b1f5-254ac8abe9f8', 'volume_name': 'volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bbeb89-10a1-4b90-932f-42b0c624968b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bbeb89-10a1-4b90-932f-42b0c624968b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcd9609-ce5e-439e-8598-a2b526991a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:42 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Volume 4e18ae59-5276-4ce1-b1f5-254ac8abe9f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8', 'volume_size': 1}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:42 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a 1073741824" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:42 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a
Apr 22 02:44:42 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:43 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a" returned: 0 in 0.414s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1537724529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae4626de-6d56-4696-a02c-a482af6f12c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e2e4c2cc2245bea4a633dd6c1d1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='eef4e2e6621744dab9b57460be338040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Creating volume ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:43 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e14d41-d4d9-482d-81cc-6b050724bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79edae19-61dc-43e9-951d-045305601e6a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:43 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 1073741824
Apr 22 02:44:43 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b57bdee-c960-4fa5-a7f6-083b6625f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:43 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume volume-79edae19-61dc-43e9-951d-045305601e6a (79edae19-61dc-43e9-951d-045305601e6a): created successfully
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b57bdee-c960-4fa5-a7f6-083b6625f62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (ce4da569-68fe-4134-987f-518b7d85680f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:43 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ade3a4cf-1d57-46b1-9b69-5b77cf0699a2 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created volume successfully.
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:43 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 1073741824" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:43 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0
Apr 22 02:44:43 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:44 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0" returned: 0 in 0.403s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1316395976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7fa6d-926b-45b2-b6e5-acb9017f2b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Creating volume 53b7fa6d-926b-45b2-b6e5-acb9017f2b0c {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:44 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de499228-6802-41e7-bff8-fdc54bdfe6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae4626de-6d56-4696-a02c-a482af6f12c0', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:44 devstack sudo[90573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c 1073741824
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050423ad-23ab-4905-9429-61cbf5be1734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:44 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:44 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Volume volume-ae4626de-6d56-4696-a02c-a482af6f12c0 (ae4626de-6d56-4696-a02c-a482af6f12c0): created successfully
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050423ad-23ab-4905-9429-61cbf5be1734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Flow 'volume_create_manager' (63583710-aff0-40c0-af13-8390d1050252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:44 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-c61dc880-1c14-48f9-a0be-201804e71e4c tempest-VolumeDependencyTests-1881694442 None] Created volume successfully.
Apr 22 02:44:44 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c 1073741824" returned: 0 in 0.504s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:44 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c
Apr 22 02:44:44 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:45 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c" returned: 0 in 0.415s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.277s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-633952717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d5d088d-fe76-47e6-9dd5-de84af6135cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Creating volume 7d5d088d-fe76-47e6-9dd5-de84af6135cd {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:45 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34516330-4263-4f2a-87de-194a3777d560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c885e7d4-5636-448a-9d62-7111e08f01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:45 devstack sudo[90581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd 1073741824
Apr 22 02:44:45 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:45 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Volume volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c (53b7fa6d-926b-45b2-b6e5-acb9017f2b0c): created successfully
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c885e7d4-5636-448a-9d62-7111e08f01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (6db16ef7-9fe7-484a-9b47-2c31352b32c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:45 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a87b86e9-3326-40de-820e-cbe942999fdf tempest-CreateVolumesFromImageTest-1777556079 None] Created volume successfully.
Apr 22 02:44:45 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd 1073741824" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:45 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd
Apr 22 02:44:45 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:46 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd" returned: 0 in 0.409s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-786516876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669ceb5f-5a90-4438-b250-155f775984c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Creating volume 669ceb5f-5a90-4438-b250-155f775984c3 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:46 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987622a7-e03e-4519-a461-ab19922b2f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:46 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3 1073741824
Apr 22 02:44:46 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6df788-e330-47a1-8f86-9fdfbc60d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:46 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Volume volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd (7d5d088d-fe76-47e6-9dd5-de84af6135cd): created successfully
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea6df788-e330-47a1-8f86-9fdfbc60d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (595cd676-609c-42e7-8c97-eb891b4d202d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:46 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b6eaeec4-a07d-41af-a348-857ecacc9304 tempest-CreateVolumesFromImageTest-1777556079 None] Created volume successfully.
Apr 22 02:44:46 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3 1073741824" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:46 devstack sudo[90594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3
Apr 22 02:44:46 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:47 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3" returned: 0 in 0.406s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.793s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762218281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dd399cb-5d25-479c-84be-eb4ed1ec6bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d1422e48d54049945345c9526ff253',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:41Z,use_quota=True,user_id='a59888e051d04672a6f93d75f62a8906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Creating volume 3dd399cb-5d25-479c-84be-eb4ed1ec6bfa {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:47 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e80aa76-bfed-43bc-8d19-c754f912b383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669ceb5f-5a90-4438-b250-155f775984c3', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61620e4c-9f11-4531-8c7d-8bbbcd954bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:47 devstack sudo[90597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa 1073741824
Apr 22 02:44:47 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:47 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Volume volume-669ceb5f-5a90-4438-b250-155f775984c3 (669ceb5f-5a90-4438-b250-155f775984c3): created successfully
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61620e4c-9f11-4531-8c7d-8bbbcd954bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (15d76ffe-9c01-42e2-a859-0b69752c9587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:47 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0d995722-7c76-4944-8906-706641e8508f tempest-CreateVolumesFromImageTest-1777556079 None] Created volume successfully.
Apr 22 02:44:47 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa 1073741824" returned: 0 in 0.463s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:47 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:47 devstack sudo[90602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa
Apr 22 02:44:47 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:48 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa" returned: 0 in 0.408s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.167s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1410154162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e18ae59-5276-4ce1-b1f5-254ac8abe9f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40bd252704f34ac69fdd8b62dce627de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:43Z,use_quota=True,user_id='f070b13a060e422db7e811b3145e9189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Creating volume 4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:48 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93ab5b7-05d0-4fe3-8201-a18b108d45b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c650b4-bb81-491d-8e73-1227fb9a5354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:48 devstack sudo[90605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 1073741824
Apr 22 02:44:48 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:48 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Volume volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa (3dd399cb-5d25-479c-84be-eb4ed1ec6bfa): created successfully
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c650b4-bb81-491d-8e73-1227fb9a5354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Flow 'volume_create_manager' (7e3394ff-99aa-4fb8-917e-264c3cc9bd78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:48 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2869d94e-1f05-45c4-b6fd-fba2854ca1a6 tempest-CreateVolumesFromImageTest-1777556079 None] Created volume successfully.
Apr 22 02:44:48 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 1073741824" returned: 0 in 0.475s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:48 devstack sudo[90610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8
Apr 22 02:44:48 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-quobyte-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211c28e-b919-4eb3-8d7d-34e167881875]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:48 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:48 devstack sudo[90612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa
Apr 22 02:44:48 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:49 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" returned: 0 in 0.426s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.158s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcd9609-ce5e-439e-8598-a2b526991a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19dc9cc-7b05-495b-8785-4dcc29fb3b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Creating offline snapshot 1142eae7-210c-40a8-a0dd-de22901fdf95 of volume 79edae19-61dc-43e9-951d-045305601e6a {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:44:49 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Volume volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 (4e18ae59-5276-4ce1-b1f5-254ac8abe9f8): created successfully
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19dc9cc-7b05-495b-8785-4dcc29fb3b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Flow 'volume_create_manager' (86126914-f4ce-4b7a-9f6f-75923935920f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[019435d1-80c0-4f3f-b427-aafc19ac2066]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:49 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-922600be-fa18-4de5-b374-33ef5e37b227 tempest-CinderUnicodeTest-364926599 None] Created volume successfully.
Apr 22 02:44:49 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a
Apr 22 02:44:49 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:49 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:49 devstack sudo[90620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa
Apr 22 02:44:49 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:49 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a" returned: 0 in 0.512s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:49 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 1G
Apr 22 02:44:49 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:49 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa" returned: 0 in 0.401s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa" released by "delete_volume" :: held 0.924s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Created reservations ['a44384e2-d7ef-4f6f-b191-6b60cdbbcc91', 'e618866a-8e74-4618-87fe-29ce3a6b8555', '8a1caef7-5a8b-4117-9fe6-26eaa42d97aa', 'ce8aa376-dcc2-47ba-92f6-246906a70e9a'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:49 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:49 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:49 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-669ceb5f-5a90-4438-b250-155f775984c3-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-669ceb5f-5a90-4438-b250-155f775984c3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-quobyte-669ceb5f-5a90-4438-b250-155f775984c3" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-669ceb5f-5a90-4438-b250-155f775984c3" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6a1026-b639-4dba-b895-5792b7c76d4b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:50 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 1G" returned: 0 in 0.518s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79edae19-61dc-43e9-951d-045305601e6a -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:50 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3
Apr 22 02:44:50 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:50 devstack sudo[90634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79edae19-61dc-43e9-951d-045305601e6a -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95
Apr 22 02:44:50 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:50 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:50 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Deleted volume successfully.
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1603cd0f-705e-41be-998e-6ee7c6a492a2 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-3dd399cb-5d25-479c-84be-eb4ed1ec6bfa-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:50 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3" returned: 0 in 0.483s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:50 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79edae19-61dc-43e9-951d-045305601e6a -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95" returned: 0 in 0.446s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:50 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 is being set with open permissions: ugo+rw
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:50 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3
Apr 22 02:44:50 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:50 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95
Apr 22 02:44:50 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:50 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-669ceb5f-5a90-4438-b250-155f775984c3" returned: 0 in 0.400s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-669ceb5f-5a90-4438-b250-155f775984c3" released by "delete_volume" :: held 0.911s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:50 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Created reservations ['fa16f449-4f6b-4bf9-b253-e3206861e2db', 'f67318a8-1a7c-490b-b780-c0df768eb83a', '95c7e02a-5410-4888-a627-aeb7faed670a', '0a800980-f020-4781-81cb-66751c1bb6d3'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:50 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95" returned: 0 in 0.431s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:51 devstack sudo[90650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.info
Apr 22 02:44:51 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:51 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:51 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-7d5d088d-fe76-47e6-9dd5-de84af6135cd-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-7d5d088d-fe76-47e6-9dd5-de84af6135cd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-quobyte-7d5d088d-fe76-47e6-9dd5-de84af6135cd" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-7d5d088d-fe76-47e6-9dd5-de84af6135cd" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f42c4b-6d12-4121-8160-01119edd57ec]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:51 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd
Apr 22 02:44:51 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:51 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.info" returned: 0 in 0.422s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:51 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.info is being set with open permissions: ugo+rw
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:51 devstack sudo[90658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.info
Apr 22 02:44:51 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:51 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.431s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:51 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Deleted volume successfully.
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-ac4c3c83-7932-4d69-9c80-1a62c76c1325 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-669ceb5f-5a90-4438-b250-155f775984c3-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:51 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd" returned: 0 in 0.476s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:51 devstack sudo[90664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd
Apr 22 02:44:51 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:51 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.info" returned: 0 in 0.404s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.898s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Creating offline snapshot c892a335-addc-49aa-a57b-87f39d0defce of volume ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:44:51 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-f83b32ec-6237-4d6d-b12a-127a3f5cf2df tempest-CreateVolumesFromSnapshotTest-237662586 None] Create snapshot completed successfully
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e18441-8ecf-4736-9571-540432ad4767]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:51 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:51 devstack sudo[90667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0
Apr 22 02:44:51 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:52 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-7d5d088d-fe76-47e6-9dd5-de84af6135cd" returned: 0 in 0.416s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-7d5d088d-fe76-47e6-9dd5-de84af6135cd" released by "delete_volume" :: held 0.915s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Created reservations ['58b565dc-2511-43b0-a7fa-cb6fa1b91a40', 'e34a2647-f714-4420-a07f-efd8a0b0a877', 'e77054ed-1470-4ac2-bfb5-93307d9729b9', '559c8e3e-1ade-45df-a890-b6a822736f30'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:52 devstack sudo[90670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:52 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-quobyte-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f96cf10-c286-4cb4-b382-f8f7e32ece52]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:52 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0" returned: 0 in 0.525s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:52 devstack sudo[90677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce 1G
Apr 22 02:44:52 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (c41d2afe-bbfe-440d-a394-89471aff4102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40780007-2763-4b2c-9ba9-2712320bb7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40780007-2763-4b2c-9ba9-2712320bb7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1875685796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513f00fe-198a-4a63-b412-df7d70dc177a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:52Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef916680-29f8-4d40-938b-ab4a4cab291c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef916680-29f8-4d40-938b-ab4a4cab291c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd735b5e-3efc-4151-8013-6e9e12e9abae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd735b5e-3efc-4151-8013-6e9e12e9abae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513f00fe-198a-4a63-b412-df7d70dc177a', 'volume_name': 'volume-513f00fe-198a-4a63-b412-df7d70dc177a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca194e8b-f758-4b29-abff-0cfc05c2ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack sudo[90675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca194e8b-f758-4b29-abff-0cfc05c2ae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccc71e9-4f8d-4130-9ece-595ffa7f6f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume 513f00fe-198a-4a63-b412-df7d70dc177a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513f00fe-198a-4a63-b412-df7d70dc177a', 'volume_size': 1}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (d06c02f7-a93f-41b4-b488-94807a1f9955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47793ba7-538b-4c1d-b5ec-c0588ff0feb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47793ba7-538b-4c1d-b5ec-c0588ff0feb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140878035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:53Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91702e3-2bed-4480-9eb4-4678609b8cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91702e3-2bed-4480-9eb4-4678609b8cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcdc050-763a-4fa7-b8e9-afea8553063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dcdc050-763a-4fa7-b8e9-afea8553063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a', 'volume_name': 'volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c830bd-169e-4c40-bfbd-9fdda270278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84c830bd-169e-4c40-bfbd-9fdda270278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c341fd2-d04d-4bad-a9d7-0573d36b6eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a', 'volume_size': 1}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.570s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:52 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Deleted volume successfully.
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-5e7bb389-e35a-468a-ab34-ce7e0593c639 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-7d5d088d-fe76-47e6-9dd5-de84af6135cd-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (c2ed0653-1ed8-42d4-986b-d40baba296d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9556e3-749a-49c3-bc08-467de3b3cb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9556e3-749a-49c3-bc08-467de3b3cb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-554810680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83b3a30-e1e5-42b9-a888-f12ff0a5beaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:53Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa534bc2-0f63-4035-8615-164e9f0dc86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa534bc2-0f63-4035-8615-164e9f0dc86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc539563-70b2-466f-a198-6c40541ad1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc539563-70b2-466f-a198-6c40541ad1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a83b3a30-e1e5-42b9-a888-f12ff0a5beaf', 'volume_name': 'volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4403f239-557c-4f81-9047-d973c39c3858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4403f239-557c-4f81-9047-d973c39c3858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233dcfb1-c78c-44c4-b7eb-b57d29156a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:52 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume a83b3a30-e1e5-42b9-a888-f12ff0a5beaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf', 'volume_size': 1}
Apr 22 02:44:52 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:53 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c" returned: 0 in 0.664s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:53 devstack sudo[90687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c
Apr 22 02:44:53 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (b17f9069-50b2-4999-a0c6-3adc2357d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77baf692-a35a-4359-ba2e-9b35d0c1fdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77baf692-a35a-4359-ba2e-9b35d0c1fdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-609544406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d8fe3e-261a-491e-94af-48a2546d4656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:53Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:53 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ee2af6-0e0f-436e-86f6-121b3206175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ee2af6-0e0f-436e-86f6-121b3206175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93ba558-061a-4d6b-82e5-13a12269aab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93ba558-061a-4d6b-82e5-13a12269aab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d8fe3e-261a-491e-94af-48a2546d4656', 'volume_name': 'volume-04d8fe3e-261a-491e-94af-48a2546d4656', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565f0d9d-3fbe-4a1f-b308-2d8a83b166e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (565f0d9d-3fbe-4a1f-b308-2d8a83b166e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeed4654-3a66-410a-9fa4-e2d2c4a06c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume 04d8fe3e-261a-491e-94af-48a2546d4656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d8fe3e-261a-491e-94af-48a2546d4656', 'volume_size': 1}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce 1G" returned: 0 in 0.700s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4626de-6d56-4696-a02c-a482af6f12c0 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:53 devstack sudo[90689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4626de-6d56-4696-a02c-a482af6f12c0 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce
Apr 22 02:44:53 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (118b0001-7367-4d23-90e9-8e2ce38a9ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe16995-0b75-4d8e-89c0-ee26c54bf914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe16995-0b75-4d8e-89c0-ee26c54bf914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465794408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79e9470-b777-4b3e-be7c-68a3c3d44690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:53Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31904b5-d01f-49cb-9571-926f1311ecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31904b5-d01f-49cb-9571-926f1311ecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd782ec9-01e1-470f-8dd8-7d2d0ce867b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd782ec9-01e1-470f-8dd8-7d2d0ce867b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79e9470-b777-4b3e-be7c-68a3c3d44690', 'volume_name': 'volume-e79e9470-b777-4b3e-be7c-68a3c3d44690', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2280795e-8a03-44f1-976d-24b4371c71b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2280795e-8a03-44f1-976d-24b4371c71b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5f1c01-95dc-4292-bfdd-b649d1b54033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:53 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume e79e9470-b777-4b3e-be7c-68a3c3d44690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79e9470-b777-4b3e-be7c-68a3c3d44690', 'volume_size': 1}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:53 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c" returned: 0 in 0.471s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c" released by "delete_volume" :: held 1.172s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Created reservations ['2d2b4a8b-a642-4833-8fab-e71f3bcbf429', '4bf43e43-be71-4d5f-83d2-55a8d4318f0d', '51126064-990a-4831-8890-4f2d145950ea', '12504b32-1939-42a4-8074-3def1f52d919'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:53 devstack sudo[90695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:53 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:53 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae4626de-6d56-4696-a02c-a482af6f12c0 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce" returned: 0 in 0.494s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:53 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce is being set with open permissions: ugo+rw
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:53 devstack sudo[90697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce
Apr 22 02:44:53 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:53 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.421s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:53 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Deleted volume successfully.
Apr 22 02:44:53 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-64ebfb51-9fb3-4ab0-ad05-a9d2dac24185 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-53b7fa6d-926b-45b2-b6e5-acb9017f2b0c-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:54 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce" returned: 0 in 0.411s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:54 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.info
Apr 22 02:44:54 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-424567c4-2b08-4500-a49a-cbeae90bdb29-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-424567c4-2b08-4500-a49a-cbeae90bdb29-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "cinder-quobyte-424567c4-2b08-4500-a49a-cbeae90bdb29" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-424567c4-2b08-4500-a49a-cbeae90bdb29" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:54 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.info" returned: 0 in 0.444s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:54 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.info is being set with open permissions: ugo+rw
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb09ae1-1226-4d5c-a58a-848510f2c1df]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:54 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.info
Apr 22 02:44:54 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:54 devstack sudo[90705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29
Apr 22 02:44:54 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:54 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.info" returned: 0 in 0.397s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.593s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Creating offline snapshot 6972eca4-0223-44d2-a31c-10bde8cc4634 of volume 4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e4c220-439f-4982-b61a-e2d5286c6a48]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:54 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3e146897-920b-4882-b5bd-cb08030fa560 tempest-VolumeDependencyTests-1881694442 None] Create snapshot completed successfully
Apr 22 02:44:54 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29" returned: 0 in 0.481s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:54 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:55 devstack sudo[90712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8
Apr 22 02:44:55 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:55 devstack sudo[90713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29
Apr 22 02:44:55 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:55 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" returned: 0 in 0.469s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:55 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-424567c4-2b08-4500-a49a-cbeae90bdb29" returned: 0 in 0.425s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:55 devstack sudo[90720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 1G
Apr 22 02:44:55 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-quobyte-424567c4-2b08-4500-a49a-cbeae90bdb29" released by "delete_volume" :: held 0.947s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Created reservations ['6863fd01-c42c-4222-9ab6-5f6fcd49e805', 'a0d49e0f-0cfa-400e-96ee-a7b8f7059b3f', 'e424dacd-e4ee-4d1c-b6a1-1166451c4e76', 'b380c66c-744a-4ce6-b27b-f7aba9b6f0e2'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:55 devstack sudo[90722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:44:55 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Flow 'volume_create_manager' (702dc7c4-dcaf-4cc3-a7f9-ac513675692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93d4f96-3dae-414d-93b9-642a35b38ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93d4f96-3dae-414d-93b9-642a35b38ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2055914654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b85ab8f-6514-47db-a4c2-48a0e20e628e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e2e4c2cc2245bea4a633dd6c1d1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c892a335-addc-49aa-a57b-87f39d0defce,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:56Z,use_quota=True,user_id='eef4e2e6621744dab9b57460be338040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dddf467-0714-4327-9d98-df4a5274bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dddf467-0714-4327-9d98-df4a5274bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b8faf1-b63f-4a12-9283-08fcee1364ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b8faf1-b63f-4a12-9283-08fcee1364ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b85ab8f-6514-47db-a4c2-48a0e20e628e', 'volume_name': 'volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e', 'volume_size': 1, 'snapshot_id': 'c892a335-addc-49aa-a57b-87f39d0defce'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c16cb95-248e-4a84-8584-1cddfd181d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c16cb95-248e-4a84-8584-1cddfd181d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e696ac52-128b-47b1-9895-c0c435bab1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:55 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Volume 5b85ab8f-6514-47db-a4c2-48a0e20e628e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e', 'volume_size': 1, 'snapshot_id': 'c892a335-addc-49aa-a57b-87f39d0defce'}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:55 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 1G" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:55 devstack sudo[90727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634
Apr 22 02:44:55 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:55 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:55 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.481s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:56 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:44:56 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Deleted volume successfully.
Apr 22 02:44:56 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-317dae4b-f16a-4bd0-bc8c-2850ba2a7493 tempest-CreateVolumesFromImageTest-1777556079 None] Lock "cinder-424567c4-2b08-4500-a49a-cbeae90bdb29-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:44:56 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634" returned: 0 in 0.537s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:56 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 is being set with open permissions: ugo+rw
Apr 22 02:44:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:56 devstack sudo[90733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634
Apr 22 02:44:56 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:56 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634" returned: 0 in 0.466s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:56 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:56 devstack sudo[90736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.info
Apr 22 02:44:56 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:57 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.info" returned: 0 in 0.487s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:57 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.info is being set with open permissions: ugo+rw
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:57 devstack sudo[90739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.info
Apr 22 02:44:57 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:57 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.info" returned: 0 in 0.493s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.400s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1875685796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513f00fe-198a-4a63-b412-df7d70dc177a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:52Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Creating volume 513f00fe-198a-4a63-b412-df7d70dc177a {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:57 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:57 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:57 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a 1073741824
Apr 22 02:44:57 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:57 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b7940c38-59bb-479e-84da-514d326c5593 tempest-CinderUnicodeTest-364926599 None] Create snapshot completed successfully
Apr 22 02:44:58 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a 1073741824" returned: 0 in 0.527s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:58 devstack sudo[90748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a
Apr 22 02:44:58 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "cinder-6972eca4-0223-44d2-a31c-10bde8cc4634-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-6972eca4-0223-44d2-a31c-10bde8cc4634-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "cinder-quobyte-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-quobyte-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "cinder-quobyte-6972eca4-0223-44d2-a31c-10bde8cc4634" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-quobyte-6972eca4-0223-44d2-a31c-10bde8cc4634" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Deleting offline snapshot 6972eca4-0223-44d2-a31c-10bde8cc4634 of volume 4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] snapshot_file for this snap is: volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4aab35-37a3-45b2-b9d3-88f45b8d422b]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:58 devstack sudo[90750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634
Apr 22 02:44:58 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:58 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a" returned: 0 in 0.445s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.164s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2140878035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:53Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Creating volume dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:58 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ccc71e9-4f8d-4130-9ece-595ffa7f6f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513f00fe-198a-4a63-b412-df7d70dc177a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922478ba-2a14-4007-b658-b8c27f256f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:44:58 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume volume-513f00fe-198a-4a63-b412-df7d70dc177a (513f00fe-198a-4a63-b412-df7d70dc177a): created successfully
Apr 22 02:44:58 devstack sudo[90753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a 1073741824
Apr 22 02:44:58 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922478ba-2a14-4007-b658-b8c27f256f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:44:58 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (c41d2afe-bbfe-440d-a394-89471aff4102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:44:58 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-262a94bc-bc41-4388-9b59-7c9916c80ab1 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created volume successfully.
Apr 22 02:44:59 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634" returned: 0 in 0.523s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e436f234-2c0e-432c-9d46-8c192664df0f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:59 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8
Apr 22 02:44:59 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:59 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a 1073741824" returned: 0 in 0.514s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:59 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a
Apr 22 02:44:59 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:59 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" returned: 0 in 0.545s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:59 devstack sudo[90768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634
Apr 22 02:44:59 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:44:59 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a" returned: 0 in 0.482s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.014s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-554810680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83b3a30-e1e5-42b9-a888-f12ff0a5beaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:53Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Creating volume a83b3a30-e1e5-42b9-a888-f12ff0a5beaf {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:44:59 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:44:59 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c341fd2-d04d-4bad-a9d7-0573d36b6eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644c45ad-6c7c-486d-b907-b4a00d588a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:00 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf 1073741824
Apr 22 02:45:00 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:00 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a (dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a): created successfully
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644c45ad-6c7c-486d-b907-b4a00d588a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (d06c02f7-a93f-41b4-b488-94807a1f9955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:00 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-98560f12-9812-4d86-a7db-91cd0286a904 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created volume successfully.
Apr 22 02:45:00 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634" returned: 0 in 0.530s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:00 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634
Apr 22 02:45:00 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:00 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf 1073741824" returned: 0 in 0.519s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:00 devstack sudo[90781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf
Apr 22 02:45:00 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:00 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8.6972eca4-0223-44d2-a31c-10bde8cc4634" returned: 0 in 0.486s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-quobyte-6972eca4-0223-44d2-a31c-10bde8cc4634" released by "_delete_snapshot" :: held 2.137s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-quobyte-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" released by "delete_snapshot" :: held 2.151s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Created reservations ['61837898-0a31-421e-9492-77108802bb99', 'c616c30a-ded6-4b56-9b3f-fa38a12fc7cd', '4e9d99f2-6014-4b5b-a4f2-c2a799c90c98', 'aaf4c902-ff0f-428e-b8bb-e6efb930e9da'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:00 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Delete snapshot completed successfully.
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9ba5e5cf-82f6-4135-b9d2-601a182f81a8 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-6972eca4-0223-44d2-a31c-10bde8cc4634-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:00 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf" returned: 0 in 0.436s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.832s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-609544406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d8fe3e-261a-491e-94af-48a2546d4656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:53Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Creating volume 04d8fe3e-261a-491e-94af-48a2546d4656 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:00 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233dcfb1-c78c-44c4-b7eb-b57d29156a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:00 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701b278e-a37e-4aa7-b7a9-02d262183254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:00 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656 1073741824
Apr 22 02:45:00 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:00 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf (a83b3a30-e1e5-42b9-a888-f12ff0a5beaf): created successfully
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701b278e-a37e-4aa7-b7a9-02d262183254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (c2ed0653-1ed8-42d4-986b-d40baba296d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:01 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a2025791-06e3-4574-a591-651bbad16f1d tempest-CreateVolumesFromSnapshotTest-237662586 None] Created volume successfully.
Apr 22 02:45:01 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656 1073741824" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:01 devstack sudo[90790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656
Apr 22 02:45:01 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Acquiring lock "cinder-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Lock "cinder-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:01 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Acquiring lock "cinder-quobyte-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656" returned: 0 in 0.462s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.612s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465794408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79e9470-b777-4b3e-be7c-68a3c3d44690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15bcb4610bb64984be01bafebdfba068',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:44:53Z,use_quota=True,user_id='510fe1b6f00f456f884af449d4ee1226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Creating volume e79e9470-b777-4b3e-be7c-68a3c3d44690 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:01 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeed4654-3a66-410a-9fa4-e2d2c4a06c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d8fe3e-261a-491e-94af-48a2546d4656', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:01 devstack sudo[90794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690 1073741824
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76e6fcf-74d3-4e92-8ed0-319d8626dc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:01 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Lock "cinder-quobyte-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" acquired by "delete_volume" :: waited 0.042s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ce3f33-b361-46bf-b937-74e0ee36326c]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:01 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:02 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume volume-04d8fe3e-261a-491e-94af-48a2546d4656 (04d8fe3e-261a-491e-94af-48a2546d4656): created successfully
Apr 22 02:45:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a76e6fcf-74d3-4e92-8ed0-319d8626dc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:02 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (b17f9069-50b2-4999-a0c6-3adc2357d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:02 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-4604f515-ef6f-4992-b3a0-0074d0e1cd59 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created volume successfully.
Apr 22 02:45:02 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8
Apr 22 02:45:02 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:02 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690 1073741824" returned: 0 in 0.592s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:02 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" returned: 0 in 0.610s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:02 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:02 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690
Apr 22 02:45:02 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:02 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8
Apr 22 02:45:02 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:03 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.369s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-c892a335-addc-49aa-a57b-87f39d0defce-5b85ab8f-6514-47db-a4c2-48a0e20e628e" by "_create_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c5f1c01-95dc-4292-bfdd-b649d1b54033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79e9470-b777-4b3e-be7c-68a3c3d44690', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fab725-41a5-4d13-bff7-a29b419c43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-c892a335-addc-49aa-a57b-87f39d0defce-5b85ab8f-6514-47db-a4c2-48a0e20e628e" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Creating volume 5b85ab8f-6514-47db-a4c2-48a0e20e628e from snapshot c892a335-addc-49aa-a57b-87f39d0defce {{(pid=82678) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-5b85ab8f-6514-47db-a4c2-48a0e20e628e" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:03 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Volume volume-e79e9470-b777-4b3e-be7c-68a3c3d44690 (e79e9470-b777-4b3e-be7c-68a3c3d44690): created successfully
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6fab725-41a5-4d13-bff7-a29b419c43e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Flow 'volume_create_manager' (118b0001-7367-4d23-90e9-8e2ce38a9ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-5bd119cb-0cb4-4946-98b3-a06f5fa61a98 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created volume successfully.
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-5b85ab8f-6514-47db-a4c2-48a0e20e628e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] snapshot: c892a335-addc-49aa-a57b-87f39d0defce, volume: 5b85ab8f-6514-47db-a4c2-48a0e20e628e,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[348c8b79-7e85-4cd9-a7f2-f2bcb8e6e564]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:03 devstack sudo[90810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce
Apr 22 02:45:03 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:03 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" returned: 0 in 0.583s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Lock "cinder-quobyte-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8" released by "delete_volume" :: held 1.236s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Created reservations ['3bde7706-67e2-4f17-88a3-b62136143adc', 'b2be3915-b496-4796-8efd-7773244d39e7', '0451f8ac-400a-471f-a005-815fd21b25e0', '4b25f89e-7485-494d-af7d-2085f6bff784'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:03 devstack sudo[90812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:03 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:03 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce" returned: 0 in 0.554s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae4626de-6d56-4696-a02c-a482af6f12c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[416af714-4aec-42e6-8ce1-198ec510e46f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:03 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0
Apr 22 02:45:03 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:03 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.480s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:03 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Deleted volume successfully.
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b9bc2c28-32f4-4382-b41a-c0bb990a354d tempest-CinderUnicodeTest-364926599 None] Lock "cinder-4e18ae59-5276-4ce1-b1f5-254ac8abe9f8-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:03 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "cinder-c873bc60-6525-4d3c-b6d5-232f452e0288-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-e79e9470-b777-4b3e-be7c-68a3c3d44690-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-c873bc60-6525-4d3c-b6d5-232f452e0288-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-e79e9470-b777-4b3e-be7c-68a3c3d44690-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "cinder-quobyte-c873bc60-6525-4d3c-b6d5-232f452e0288" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-quobyte-e79e9470-b777-4b3e-be7c-68a3c3d44690" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-quobyte-c873bc60-6525-4d3c-b6d5-232f452e0288" acquired by "delete_volume" :: waited 0.024s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-e79e9470-b777-4b3e-be7c-68a3c3d44690" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafccd0e-986f-4860-9675-1196f738eefd]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae2d164-7d99-4e95-b871-5ea1ae78687d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:04 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288
Apr 22 02:45:04 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:04 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690
Apr 22 02:45:04 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:04 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0" returned: 0 in 0.601s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:04 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e
Apr 22 02:45:04 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:04 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288" returned: 0 in 0.509s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:04 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288
Apr 22 02:45:04 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:04 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690" returned: 0 in 0.578s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:04 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:04 devstack sudo[90840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690
Apr 22 02:45:04 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:05 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:05 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-e79e9470-b777-4b3e-be7c-68a3c3d44690" returned: 0 in 1.222s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:05 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-e79e9470-b777-4b3e-be7c-68a3c3d44690" released by "delete_volume" :: held 1.830s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Created reservations ['95442a73-7b62-4d73-aaff-e7afad4c0868', 'a48a4269-76e3-4f4c-b062-acb47c0fb8f1', 'ce82bd10-f506-48c4-a5b9-18269ab2c20c', 'af1ba8a4-a628-450c-8c82-b8f157d5d659'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:06 devstack sudo[90853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:06 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:06 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-c873bc60-6525-4d3c-b6d5-232f452e0288" returned: 0 in 1.734s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-quobyte-c873bc60-6525-4d3c-b6d5-232f452e0288" released by "delete_volume" :: held 2.275s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Created reservations ['8edf03cc-9638-467a-9116-6961c0841bb8', '9ea3ef4e-7783-494d-bba2-23215432d429', '632f0292-e3f8-45d2-9857-06c313500856', '61657abc-300b-4cb3-b15d-593aa41219a9'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-04d8fe3e-261a-491e-94af-48a2546d4656-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-04d8fe3e-261a-491e-94af-48a2546d4656-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:06 devstack sudo[90855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:06 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-quobyte-04d8fe3e-261a-491e-94af-48a2546d4656" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-04d8fe3e-261a-491e-94af-48a2546d4656" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[540dcb37-3652-4a46-90b2-39742355f443]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:06 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656
Apr 22 02:45:06 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:06 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e" returned: 0 in 2.630s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff1c3f2-b6d4-475e-8ed8-da296e0ae182]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:06 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:07 devstack sudo[90859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0
Apr 22 02:45:07 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:07 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 1.114s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Deleted volume successfully.
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6a2d45fb-1cf7-4fbf-97f1-c132882824cf tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-e79e9470-b777-4b3e-be7c-68a3c3d44690-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:07 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656" returned: 0 in 0.638s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:07 devstack sudo[90866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656
Apr 22 02:45:07 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:07 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.883s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:07 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Deleted volume successfully.
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-00e377a1-4b60-4fb5-a940-3024d160a633 tempest-CinderUnicodeTest-364926599 None] Lock "cinder-c873bc60-6525-4d3c-b6d5-232f452e0288-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:07 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-04d8fe3e-261a-491e-94af-48a2546d4656" returned: 0 in 0.569s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-04d8fe3e-261a-491e-94af-48a2546d4656" released by "delete_volume" :: held 1.237s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:07 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created reservations ['25f7dd47-847b-4154-8f08-e580f8899811', '749218cf-9f2f-4b88-9723-235560eff363', '5ab73f9a-2ab4-46b2-a189-04353cfc1124', '1583cb80-7bcb-42a9-b238-c5851a7d5e16'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0" returned: 0 in 1.002s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0, size 1024.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:45:07 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Converted 1024.00 MB image at 389.06 MB/s
Apr 22 02:45:07 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e is being set with open permissions: ugo+rw
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:07 devstack sudo[90872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e
Apr 22 02:45:07 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:07 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:08 devstack sudo[90874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:08 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:08 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-5b85ab8f-6514-47db-a4c2-48a0e20e628e" released by "_copy_volume_from_snapshot" :: held 5.344s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-c892a335-addc-49aa-a57b-87f39d0defce-5b85ab8f-6514-47db-a4c2-48a0e20e628e" released by "_create_volume_from_snapshot" :: held 5.372s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.392s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e696ac52-128b-47b1-9895-c0c435bab1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e', 'volume_size': 1, 'snapshot_id': 'c892a335-addc-49aa-a57b-87f39d0defce'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35152ab-0f55-4991-9fa6-1bfc59c483ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:08 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Volume volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e (5b85ab8f-6514-47db-a4c2-48a0e20e628e): created successfully
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35152ab-0f55-4991-9fa6-1bfc59c483ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Flow 'volume_create_manager' (702dc7c4-dcaf-4cc3-a7f9-ac513675692f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:08 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-0ebe43d8-37ec-431d-be69-5e775374bbfd tempest-VolumeDependencyTests-1881694442 None] Created volume successfully.
Apr 22 02:45:08 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.536s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:08 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Deleted volume successfully.
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-32a836e8-ad73-4bdf-aa40-b12d1203bfb6 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-04d8fe3e-261a-491e-94af-48a2546d4656-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-c892a335-addc-49aa-a57b-87f39d0defce-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-c892a335-addc-49aa-a57b-87f39d0defce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-ae4626de-6d56-4696-a02c-a482af6f12c0" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-ae4626de-6d56-4696-a02c-a482af6f12c0" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-c892a335-addc-49aa-a57b-87f39d0defce" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-c892a335-addc-49aa-a57b-87f39d0defce" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Deleting offline snapshot c892a335-addc-49aa-a57b-87f39d0defce of volume ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] snapshot_file for this snap is: volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9787b6-6881-484d-800d-bc042a14ec89]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:08 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce
Apr 22 02:45:08 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:08 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-quobyte-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf" acquired by "delete_volume" :: waited 0.014s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[352d1639-5fd0-4f63-8848-244a85b3f2d0]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:09 devstack sudo[90880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf
Apr 22 02:45:09 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:09 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce" returned: 0 in 0.596s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae4626de-6d56-4696-a02c-a482af6f12c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e7526-94c8-4edf-801e-9494b5bcb213]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:09 devstack sudo[90885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0
Apr 22 02:45:09 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:09 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf" returned: 0 in 0.606s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:09 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:09 devstack sudo[90890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf
Apr 22 02:45:09 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:10 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0" returned: 0 in 0.774s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:10 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce
Apr 22 02:45:10 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:10 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf" returned: 0 in 0.580s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf" released by "delete_volume" :: held 1.208s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created reservations ['7c126c32-11e2-4245-845b-4d4c400e24d6', 'b7bd4c32-f216-4e79-b3d4-fd4046172e99', 'cb1fa9ae-f3b5-42ca-aec5-fab469591abf', '18cf0a6f-6a1d-4f2b-81ba-06fa85665ae7'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:10 devstack sudo[90898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:10 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:10 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce" returned: 0 in 0.679s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:10 devstack sudo[90903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce
Apr 22 02:45:10 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:10 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.547s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:10 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Deleted volume successfully.
Apr 22 02:45:10 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9f681935-3c47-47f4-a853-8efe8fcd8992 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-a83b3a30-e1e5-42b9-a888-f12ff0a5beaf-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Flow 'volume_create_manager' (ef0e078d-a220-4e36-a0fb-751d182e7305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9b7138-181d-4760-848a-ea1c99a8092c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9b7138-181d-4760-848a-ea1c99a8092c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1643234103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537e0e0b-1769-451b-b6ee-7e7debacf72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1d7c3852c9471588f58716b80491be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:11Z,use_quota=True,user_id='d815be156b304cb99217a0f7c3832440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769afe97-d246-48f1-97dd-7d5cf8ae63ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769afe97-d246-48f1-97dd-7d5cf8ae63ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c937be65-9df4-427d-8537-ba52637fa51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c937be65-9df4-427d-8537-ba52637fa51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537e0e0b-1769-451b-b6ee-7e7debacf72a', 'volume_name': 'volume-537e0e0b-1769-451b-b6ee-7e7debacf72a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78242fae-2223-492f-99dc-ae7fbcc66688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78242fae-2223-492f-99dc-ae7fbcc66688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f111b90f-fead-4a36-a814-f3b45aed13ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:11 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Volume 537e0e0b-1769-451b-b6ee-7e7debacf72a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537e0e0b-1769-451b-b6ee-7e7debacf72a', 'volume_size': 1}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1643234103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537e0e0b-1769-451b-b6ee-7e7debacf72a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1d7c3852c9471588f58716b80491be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:11Z,use_quota=True,user_id='d815be156b304cb99217a0f7c3832440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Creating volume 537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:11 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:11 devstack sudo[90907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a 1073741824
Apr 22 02:45:11 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:11 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0.c892a335-addc-49aa-a57b-87f39d0defce" returned: 0 in 0.486s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-c892a335-addc-49aa-a57b-87f39d0defce" released by "_delete_snapshot" :: held 2.617s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-quobyte-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-ae4626de-6d56-4696-a02c-a482af6f12c0" released by "delete_snapshot" :: held 2.637s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a" acquired by "delete_volume" :: waited 0.028s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fd432d-8289-495d-8e47-38607e8640a8]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Created reservations ['186f7af0-8662-49f7-bb0b-d1567b6662c9', 'a0dbc109-553e-47b4-a019-6ff0b5c7bcaa', 'efec7bc9-344d-4b27-9613-804b3744544d', '040466dc-983a-4b6f-ae7c-ed1156e9b95b'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:11 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Delete snapshot completed successfully.
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a9870a13-1315-4780-8655-ba41a52730bb tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-c892a335-addc-49aa-a57b-87f39d0defce-delete_snapshot" released by "delete_snapshot" :: held 2.741s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:11 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a
Apr 22 02:45:11 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:11 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a 1073741824" returned: 0 in 0.569s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:11 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a
Apr 22 02:45:11 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-ae4626de-6d56-4696-a02c-a482af6f12c0-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-ae4626de-6d56-4696-a02c-a482af6f12c0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:11 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-ae4626de-6d56-4696-a02c-a482af6f12c0" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a" returned: 0 in 0.494s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:11 devstack sudo[90920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a
Apr 22 02:45:11 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-ae4626de-6d56-4696-a02c-a482af6f12c0" acquired by "delete_volume" :: waited 0.025s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a32d6de-5ebf-4fdf-ba1c-073490eb8137]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:11 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:11 devstack sudo[90922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0
Apr 22 02:45:11 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:12 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a" returned: 0 in 0.441s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f111b90f-fead-4a36-a814-f3b45aed13ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537e0e0b-1769-451b-b6ee-7e7debacf72a', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb31254-69a0-4239-8f03-80950388d6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:12 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Volume volume-537e0e0b-1769-451b-b6ee-7e7debacf72a (537e0e0b-1769-451b-b6ee-7e7debacf72a): created successfully
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb31254-69a0-4239-8f03-80950388d6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Flow 'volume_create_manager' (ef0e078d-a220-4e36-a0fb-751d182e7305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:12 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-07675d1d-759e-40f7-8e3b-f06cf6e29910 tempest-SnapshotDependencyTests-996625613 None] Created volume successfully.
Apr 22 02:45:12 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a" returned: 0 in 0.416s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a" released by "delete_volume" :: held 0.936s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created reservations ['14b51ba5-c027-4a0e-b626-13ce8eb36da3', '14b36a50-8ecc-421c-aa63-0ff10a372cb6', '6e71b834-47d3-4576-a326-689916ede7a4', 'ec154a5c-8a40-49e3-9759-146b399bb3e2'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:12 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0" returned: 0 in 0.499s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:12 devstack sudo[90929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:12 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:12 devstack sudo[90930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0
Apr 22 02:45:12 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:12 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.398s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:12 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Deleted volume successfully.
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-1ea66878-29b3-4752-8065-6a8ab2b6dbc9 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-dc6da0a8-4e3f-4f2c-b458-09fd6eec5f5a-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:12 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-ae4626de-6d56-4696-a02c-a482af6f12c0" returned: 0 in 0.434s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-ae4626de-6d56-4696-a02c-a482af6f12c0" released by "delete_volume" :: held 0.961s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Created reservations ['17e2cbe2-2a80-43f1-8a8d-318d02a84e36', 'a462748b-181b-47c7-8666-fe4250947698', '464da419-3717-4d3c-b995-f81153a359f4', '9fc1b89d-3a84-4dfa-a0f4-9b20a19ea1ef'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:12 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:12 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:12 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Flow 'volume_create_manager' (c28e06b7-5455-46f9-b605-5b8b7240d1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c38824-85fd-42e1-8185-072f776b6b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c38824-85fd-42e1-8185-072f776b6b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-481151286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e2e4c2cc2245bea4a633dd6c1d1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:13Z,use_quota=True,user_id='eef4e2e6621744dab9b57460be338040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e89991-4a33-4a3d-99ad-537e27c7ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e89991-4a33-4a3d-99ad-537e27c7ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79c5d83-f3ea-432d-a5f7-cdb622c85609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79c5d83-f3ea-432d-a5f7-cdb622c85609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3', 'volume_name': 'volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d0caa1-a93f-4005-a2dd-41e7b1ee3d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d0caa1-a93f-4005-a2dd-41e7b1ee3d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f995f4-79f3-42aa-97e2-931ab9837d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:13 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Volume 3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3', 'volume_size': 1}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-481151286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e2e4c2cc2245bea4a633dd6c1d1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:13Z,use_quota=True,user_id='eef4e2e6621744dab9b57460be338040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Creating volume 3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:13 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:13 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 1073741824
Apr 22 02:45:13 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:13 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.492s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:13 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Deleted volume successfully.
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-513f00fe-198a-4a63-b412-df7d70dc177a-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-04303098-7117-4c4b-a0d5-f96ac6558dc9 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-ae4626de-6d56-4696-a02c-a482af6f12c0-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-513f00fe-198a-4a63-b412-df7d70dc177a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-quobyte-513f00fe-198a-4a63-b412-df7d70dc177a" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-513f00fe-198a-4a63-b412-df7d70dc177a" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[68885a01-6524-4c3f-aff2-6d90e6786879]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:13 devstack sudo[90948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a
Apr 22 02:45:13 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:13 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 1073741824" returned: 0 in 0.541s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:13 devstack sudo[90953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3
Apr 22 02:45:13 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:13 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a" returned: 0 in 0.505s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:13 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:13 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a
Apr 22 02:45:13 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:14 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" returned: 0 in 0.414s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.815s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f995f4-79f3-42aa-97e2-931ab9837d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a381610a-55dc-41f1-b313-8b5b8c86cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Creating offline snapshot 9555c3b9-f7aa-4a77-ba1d-175fdf20a47a of volume 537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:45:14 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Volume volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 (3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3): created successfully
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a381610a-55dc-41f1-b313-8b5b8c86cec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Flow 'volume_create_manager' (c28e06b7-5455-46f9-b605-5b8b7240d1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74cf8da-0711-4851-937c-1ab8a01d8046]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:14 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-114c0236-eb71-48d8-9e8a-da755dbc5f52 tempest-VolumeDependencyTests-1881694442 None] Created volume successfully.
Apr 22 02:45:14 devstack sudo[90961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a
Apr 22 02:45:14 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:14 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-513f00fe-198a-4a63-b412-df7d70dc177a" returned: 0 in 0.435s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-513f00fe-198a-4a63-b412-df7d70dc177a" released by "delete_volume" :: held 0.959s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created reservations ['f97dc501-9f38-4b69-89f4-baccc0b855e6', '4d62701f-313c-4bb4-89db-87f8847ee5e3', '9ee37c71-0b0a-46ca-bd86-1c57309dd774', '409903a4-47a1-47a4-9bf3-77e3e4b4021d'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:14 devstack sudo[90964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:14 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-1142eae7-210c-40a8-a0dd-de22901fdf95-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-1142eae7-210c-40a8-a0dd-de22901fdf95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-quobyte-79edae19-61dc-43e9-951d-045305601e6a" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-79edae19-61dc-43e9-951d-045305601e6a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-quobyte-1142eae7-210c-40a8-a0dd-de22901fdf95" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-1142eae7-210c-40a8-a0dd-de22901fdf95" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Deleting offline snapshot 1142eae7-210c-40a8-a0dd-de22901fdf95 of volume 79edae19-61dc-43e9-951d-045305601e6a {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] snapshot_file for this snap is: volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a03ae3b-9ca2-41bf-b6ed-f0fa2dfd80b8]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:14 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95
Apr 22 02:45:14 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:14 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a" returned: 0 in 0.511s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:14 devstack sudo[90971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a 1G
Apr 22 02:45:14 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:14 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.429s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:14 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Deleted volume successfully.
Apr 22 02:45:14 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-dd25c647-0e50-4e6a-85c9-4b5d729c7903 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-513f00fe-198a-4a63-b412-df7d70dc177a-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:15 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95" returned: 0 in 0.469s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79edae19-61dc-43e9-951d-045305601e6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[24849d7b-2562-4e59-8659-5adde4f65c61]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:15 devstack sudo[90977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a
Apr 22 02:45:15 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:15 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a 1G" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-537e0e0b-1769-451b-b6ee-7e7debacf72a -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:15 devstack sudo[90982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-537e0e0b-1769-451b-b6ee-7e7debacf72a -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a
Apr 22 02:45:15 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Flow 'volume_create_manager' (6cb071f4-68c3-445e-aaa4-2dc9fd9ff836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6765ab-25dc-48eb-9901-22ea9414765f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6765ab-25dc-48eb-9901-22ea9414765f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-724389434',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284d173b-313b-4bdf-b672-034d59a3fa63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e2e4c2cc2245bea4a633dd6c1d1e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:15Z,use_quota=True,user_id='eef4e2e6621744dab9b57460be338040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56eaf102-14fb-46a7-b4b2-af830552ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56eaf102-14fb-46a7-b4b2-af830552ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f230e507-6121-4459-9474-dd8e05206aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f230e507-6121-4459-9474-dd8e05206aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '284d173b-313b-4bdf-b672-034d59a3fa63', 'volume_name': 'volume-284d173b-313b-4bdf-b672-034d59a3fa63', 'volume_size': 1, 'source_volid': '3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3', 'source_volstatus': 'available'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf94622b-6c67-449f-87cb-c74bf6d84a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf94622b-6c67-449f-87cb-c74bf6d84a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c4aefe-4f2c-496b-959e-0158f808de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:15 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Volume 284d173b-313b-4bdf-b672-034d59a3fa63: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-284d173b-313b-4bdf-b672-034d59a3fa63', 'volume_size': 1, 'source_volid': '3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3', 'source_volstatus': 'available'}
Apr 22 02:45:15 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a" returned: 0 in 0.537s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:15 devstack sudo[90987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95
Apr 22 02:45:15 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:15 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-537e0e0b-1769-451b-b6ee-7e7debacf72a -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" returned: 0 in 0.490s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:15 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a is being set with open permissions: ugo+rw
Apr 22 02:45:15 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:15 devstack sudo[90992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a
Apr 22 02:45:15 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:16 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95" returned: 0 in 0.450s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:16 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95
Apr 22 02:45:16 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:16 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" returned: 0 in 0.404s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:16 devstack sudo[91000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.info
Apr 22 02:45:16 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:16 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a.1142eae7-210c-40a8-a0dd-de22901fdf95" returned: 0 in 0.410s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-1142eae7-210c-40a8-a0dd-de22901fdf95" released by "_delete_snapshot" :: held 1.923s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-79edae19-61dc-43e9-951d-045305601e6a" released by "delete_snapshot" :: held 1.933s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created reservations ['e951e080-3f13-4d25-a648-6f19254c47d5', '0675072e-0f13-48fd-a9c3-2600e3b9fba1', 'a07952a0-4de4-4f3a-9e95-2bd9ab094d0c', '92a20db6-1f3a-4cbb-89ee-e052bdd70890'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:16 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Delete snapshot completed successfully.
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-3ac41be4-2124-4fc2-a972-0b3539bbf462 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-1142eae7-210c-40a8-a0dd-de22901fdf95-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:16 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-79edae19-61dc-43e9-951d-045305601e6a-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.info" returned: 0 in 0.459s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:16 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.info is being set with open permissions: ugo+rw
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-79edae19-61dc-43e9-951d-045305601e6a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:16 devstack sudo[91004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.info
Apr 22 02:45:16 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "cinder-quobyte-79edae19-61dc-43e9-951d-045305601e6a" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-79edae19-61dc-43e9-951d-045305601e6a" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[846ef84e-85c6-4e2e-9883-ed572d520943]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:16 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:16 devstack sudo[91006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a
Apr 22 02:45:16 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:17 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.info" returned: 0 in 0.470s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.909s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.544s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:17 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Cloning volume 3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 to volume 284d173b-313b-4bdf-b672-034d59a3fa63
Apr 22 02:45:17 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-709e9bf7-628b-4346-8ddc-648e71777ef3 tempest-SnapshotDependencyTests-996625613 None] Create snapshot completed successfully
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Creating offline snapshot dd1f2258-5484-48aa-82e4-0914810e87f0 of volume 3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b07e7-8507-4575-88a8-3056e6efaaaa]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:17 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a" returned: 0 in 0.497s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:17 devstack sudo[91012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3
Apr 22 02:45:17 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:17 devstack sudo[91014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a
Apr 22 02:45:17 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:17 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:17 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" returned: 0 in 0.506s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-79edae19-61dc-43e9-951d-045305601e6a" returned: 0 in 0.440s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 1G {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:17 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 1G
Apr 22 02:45:17 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-quobyte-79edae19-61dc-43e9-951d-045305601e6a" released by "delete_volume" :: held 0.981s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Created reservations ['c3189aa3-0878-4d56-86eb-3b0cbd098767', '7d35326f-ae7e-4962-bd50-2380ce567d10', 'db3249fd-71b0-4eaf-a779-290dbd3b6dec', 'fb37f998-e536-4656-8343-df44b121a3ed'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:17 devstack sudo[91022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:17 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Flow 'volume_create_manager' (61d8579f-4a50-4065-9edf-6d67d1ff9517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e40e2f-9af9-4a24-876c-09fd45d261f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e40e2f-9af9-4a24-876c-09fd45d261f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d19f621-3cd2-4436-a84f-a2eb6049fb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a1d7c3852c9471588f58716b80491be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9555c3b9-f7aa-4a77-ba1d-175fdf20a47a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:18Z,use_quota=True,user_id='d815be156b304cb99217a0f7c3832440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c439ca5f-a170-4fa1-b2ed-cb82f4f001ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c439ca5f-a170-4fa1-b2ed-cb82f4f001ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f671158-45f2-4952-ab76-ffafdd9864d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f671158-45f2-4952-ab76-ffafdd9864d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d19f621-3cd2-4436-a84f-a2eb6049fb18', 'volume_name': 'volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18', 'volume_size': 1, 'snapshot_id': '9555c3b9-f7aa-4a77-ba1d-175fdf20a47a'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045f5338-e808-479a-ae4d-8ed90ea82c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045f5338-e808-479a-ae4d-8ed90ea82c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9484c51-2afb-4daf-a361-afe5bcf52167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:17 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Volume 4d19f621-3cd2-4436-a84f-a2eb6049fb18: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18', 'volume_size': 1, 'snapshot_id': '9555c3b9-f7aa-4a77-ba1d-175fdf20a47a'}
Apr 22 02:45:17 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:18 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 1G" returned: 0 in 0.493s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:18 devstack sudo[91028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0
Apr 22 02:45:18 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:18 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.441s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:18 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:18 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Deleted volume successfully.
Apr 22 02:45:18 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-b2885ba1-6c60-4c7f-adfd-0fba72e1bdb3 tempest-CreateVolumesFromSnapshotTest-237662586 None] Lock "cinder-79edae19-61dc-43e9-951d-045305601e6a-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:18 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 -F qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0" returned: 0 in 0.427s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:18 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 is being set with open permissions: ugo+rw
Apr 22 02:45:18 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:18 devstack sudo[91033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0
Apr 22 02:45:18 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:19 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0" returned: 0 in 0.448s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:19 devstack sudo[91036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.info
Apr 22 02:45:19 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:19 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.info" returned: 0 in 0.472s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:19 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.info is being set with open permissions: ugo+rw
Apr 22 02:45:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.info {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:19 devstack sudo[91039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.info
Apr 22 02:45:19 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:19 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:19 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.info" returned: 0 in 0.459s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-284d173b-313b-4bdf-b672-034d59a3fa63" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:19 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-284d173b-313b-4bdf-b672-034d59a3fa63" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:19 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] snapshot: dd1f2258-5484-48aa-82e4-0914810e87f0, volume: 284d173b-313b-4bdf-b672-034d59a3fa63,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[628e1e3f-0293-4aff-9888-e93e0f4c2ca1]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:20 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0
Apr 22 02:45:20 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (ddaf99a4-5a41-4ac8-a182-2c2a5f448d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4065a2-a0f6-4059-9f7d-d11c2a172b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4065a2-a0f6-4059-9f7d-d11c2a172b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1535095570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:20Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4097a9-73a8-4312-bc1f-35cfb2be6a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc4097a9-73a8-4312-bc1f-35cfb2be6a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd8005c-fda3-4455-a96e-14723d708116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd8005c-fda3-4455-a96e-14723d708116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac', 'volume_name': 'volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4d6771-5638-4382-9ed7-36436ada1ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed4d6771-5638-4382-9ed7-36436ada1ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386ac036-aadb-4f45-bf28-25ef8d9bb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:20 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume 90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac', 'volume_size': 1}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:20 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0" returned: 0 in 0.526s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca05ed0-8050-4899-a40a-15b26950edfa]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:20 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:20 devstack sudo[91081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3
Apr 22 02:45:20 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:21 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" returned: 0 in 0.459s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:21 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63 not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:45:21 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:21 devstack sudo[91086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63
Apr 22 02:45:21 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:22 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63" returned: 0 in 1.931s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:22 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f405e69-49a6-45be-b7af-50a2fdb253b3]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:22 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:23 devstack sudo[91099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3
Apr 22 02:45:23 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:23 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" returned: 0 in 0.583s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:45:23 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Converted 1024.00 MB image at 529.91 MB/s
Apr 22 02:45:23 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63 is being set with open permissions: ugo+rw
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:23 devstack sudo[91104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63
Apr 22 02:45:23 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:23 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63" returned: 0 in 0.398s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-284d173b-313b-4bdf-b672-034d59a3fa63" released by "_copy_volume_from_snapshot" :: held 3.941s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-dd1f2258-5484-48aa-82e4-0914810e87f0" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-dd1f2258-5484-48aa-82e4-0914810e87f0" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Deleting offline snapshot dd1f2258-5484-48aa-82e4-0914810e87f0 of volume 3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] snapshot_file for this snap is: volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[176155ed-f287-4880-bb75-b4db2342990d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:23 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:24 devstack sudo[91107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0
Apr 22 02:45:24 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:24 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0" returned: 0 in 0.464s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:24 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:45:24 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcd9514-22ce-4a09-bf13-1121e9ed9434]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:24 devstack sudo[91112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3
Apr 22 02:45:24 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:24 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" returned: 0 in 0.459s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:24 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:24 devstack sudo[91117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0
Apr 22 02:45:24 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:25 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0" returned: 0 in 0.445s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:25 devstack sudo[91122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0
Apr 22 02:45:25 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:25 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3.dd1f2258-5484-48aa-82e4-0914810e87f0" returned: 0 in 0.418s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-dd1f2258-5484-48aa-82e4-0914810e87f0" released by "_delete_snapshot" :: held 1.830s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.703s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.862s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-quobyte-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a-4d19f621-3cd2-4436-a84f-a2eb6049fb18" by "_create_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c4aefe-4f2c-496b-959e-0158f808de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284d173b-313b-4bdf-b672-034d59a3fa63', 'volume_size': 1, 'source_volid': '3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3', 'source_volstatus': 'available'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de38593a-65de-423b-828d-272d56f5b052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a-4d19f621-3cd2-4436-a84f-a2eb6049fb18" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Creating volume 4d19f621-3cd2-4436-a84f-a2eb6049fb18 from snapshot 9555c3b9-f7aa-4a77-ba1d-175fdf20a47a {{(pid=82678) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-quobyte-4d19f621-3cd2-4436-a84f-a2eb6049fb18" by "_copy_volume_from_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:25 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Volume volume-284d173b-313b-4bdf-b672-034d59a3fa63 (284d173b-313b-4bdf-b672-034d59a3fa63): created successfully
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de38593a-65de-423b-828d-272d56f5b052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Flow 'volume_create_manager' (6cb071f4-68c3-445e-aaa4-2dc9fd9ff836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-4d19f621-3cd2-4436-a84f-a2eb6049fb18" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] snapshot: 9555c3b9-f7aa-4a77-ba1d-175fdf20a47a, volume: 4d19f621-3cd2-4436-a84f-a2eb6049fb18,  {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 22 02:45:25 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-d3ac45b9-5b3b-4b15-be62-8b517b2352f8 tempest-VolumeDependencyTests-1881694442 None] Created volume successfully.
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c954fe16-b54f-409c-b867-759b83fd8987]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:25 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:25 devstack sudo[91125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a
Apr 22 02:45:25 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f9f855-5793-4a37-b0de-cb1f0a940cb3]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:26 devstack sudo[91127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3
Apr 22 02:45:26 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:26 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" returned: 0 in 0.497s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-537e0e0b-1769-451b-b6ee-7e7debacf72a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Creating direct copy from snapshot {{(pid=82678) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdbc7c3-b8a7-402d-a607-a8d16dfcd2e1]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:26 devstack sudo[91132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a
Apr 22 02:45:26 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:26 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" returned: 0 in 0.477s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:26 devstack sudo[91137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3
Apr 22 02:45:26 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:26 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a" returned: 0 in 0.477s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG cinder.utils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Path /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18 not found in is_blk_device check {{(pid=82678) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 22 02:45:26 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:26 devstack sudo[91142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18
Apr 22 02:45:26 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:27 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" returned: 0 in 0.419s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3" released by "delete_volume" :: held 0.933s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Created reservations ['39158a36-bedd-4fba-8391-00cc6bc9cf3a', '04415554-1991-42f2-a570-ad87924401dd', '13d92368-ddc1-4bd6-b285-9003c26a6a3a', 'fd5a0735-aab5-4b06-a0c5-0d79df101e86'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:27 devstack sudo[91145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:27 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-284d173b-313b-4bdf-b672-034d59a3fa63-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-284d173b-313b-4bdf-b672-034d59a3fa63-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-284d173b-313b-4bdf-b672-034d59a3fa63" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-284d173b-313b-4bdf-b672-034d59a3fa63" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e22ec-d074-46de-8c2f-fcf0f5980be2]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:27 devstack sudo[91149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63
Apr 22 02:45:27 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:27 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.852s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:27 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Deleted volume successfully.
Apr 22 02:45:27 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2a2cc234-bdf6-40bc-a70a-57f4f27fec04 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-3ae68a40-b93f-4ee6-8cee-8899b1cdb3e3-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:28 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63" returned: 0 in 1.030s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:28 devstack sudo[91163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63
Apr 22 02:45:28 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:28 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18" returned: 0 in 2.103s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:28 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c976e5ec-ca55-411c-85a7-6ade54cefb8d]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:28 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:29 devstack sudo[91165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a
Apr 22 02:45:29 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:29 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-284d173b-313b-4bdf-b672-034d59a3fa63" returned: 0 in 0.888s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-284d173b-313b-4bdf-b672-034d59a3fa63" released by "delete_volume" :: held 1.941s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Created reservations ['92022555-b928-44e3-8cfa-c8777af2ef2c', '4d1f0371-4e21-405d-9f7b-3c683a74aab6', '3aeb222b-857a-4f1a-aaa0-001de7a697a9', 'c3ad4012-7cb7-41dc-b095-e57d1c76f550'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:29 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:29 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-5b85ab8f-6514-47db-a4c2-48a0e20e628e-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-5b85ab8f-6514-47db-a4c2-48a0e20e628e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "cinder-quobyte-5b85ab8f-6514-47db-a4c2-48a0e20e628e" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-5b85ab8f-6514-47db-a4c2-48a0e20e628e" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f95046b-82d6-49a2-8cc2-3293619564ae]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:29 devstack sudo[91172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e
Apr 22 02:45:29 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:29 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a" returned: 0 in 0.636s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.image.image_utils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Image conversion details: src /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18 {{(pid=82678) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 22 02:45:29 devstack cinder-volume[82678]: INFO cinder.image.image_utils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Converted 1024.00 MB image at 486.70 MB/s
Apr 22 02:45:29 devstack cinder-volume[82678]: WARNING cinder.volume.drivers.remotefs [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18 is being set with open permissions: ugo+rw
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:29 devstack sudo[91176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18
Apr 22 02:45:29 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:29 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.451s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:29 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Deleted volume successfully.
Apr 22 02:45:29 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-50dd5b45-3446-44ea-9db6-581a7938e741 tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-284d173b-313b-4bdf-b672-034d59a3fa63-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:30 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e" returned: 0 in 0.491s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:30 devstack sudo[91182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e
Apr 22 02:45:30 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:30 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18" returned: 0 in 0.431s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-4d19f621-3cd2-4436-a84f-a2eb6049fb18" released by "_copy_volume_from_snapshot" :: held 4.200s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a-4d19f621-3cd2-4436-a84f-a2eb6049fb18" released by "_create_volume_from_snapshot" :: held 4.234s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.255s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.548s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1535095570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:20Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Creating volume 90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:30 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:30 devstack sudo[91184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac 1073741824
Apr 22 02:45:30 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9484c51-2afb-4daf-a361-afe5bcf52167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18', 'volume_size': 1, 'snapshot_id': '9555c3b9-f7aa-4a77-ba1d-175fdf20a47a'}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b15f9e2-4ea2-4b39-9dfc-3393f0a50fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:30 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Volume volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18 (4d19f621-3cd2-4436-a84f-a2eb6049fb18): created successfully
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b15f9e2-4ea2-4b39-9dfc-3393f0a50fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Flow 'volume_create_manager' (61d8579f-4a50-4065-9edf-6d67d1ff9517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:30 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-6261b67b-c783-42ce-bf23-70b3df4843dc tempest-SnapshotDependencyTests-996625613 None] Created volume successfully.
Apr 22 02:45:30 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-5b85ab8f-6514-47db-a4c2-48a0e20e628e" returned: 0 in 0.451s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-quobyte-5b85ab8f-6514-47db-a4c2-48a0e20e628e" released by "delete_volume" :: held 0.965s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Created reservations ['0aff2813-e988-4a7d-ad5c-03b468a03fe9', '7acb767e-660b-4e75-8a3e-0fa26b79dc5c', 'd150dcc5-8f36-4a94-b4de-073a0b6707b8', 'aa2f88b1-4132-4eb2-aad2-c7be6fd97b30'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:30 devstack sudo[91190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:30 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:30 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac 1073741824" returned: 0 in 0.506s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:30 devstack sudo[91192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac
Apr 22 02:45:30 devstack sudo[91192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a-delete_snapshot" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-quobyte-537e0e0b-1769-451b-b6ee-7e7debacf72a" by "delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-537e0e0b-1769-451b-b6ee-7e7debacf72a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-quobyte-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" by "_delete_snapshot" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Deleting offline snapshot 9555c3b9-f7aa-4a77-ba1d-175fdf20a47a of volume 537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] snapshot_file for this snap is: volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a {{(pid=82678) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d0dcd0-37bd-4ffa-aa29-2d5c21609c5f]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:30 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:31 devstack sudo[91195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a
Apr 22 02:45:31 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:31 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.503s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Deleted volume successfully.
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-aa4294d2-0843-4903-a677-8d327699115a tempest-VolumeDependencyTests-1881694442 None] Lock "cinder-5b85ab8f-6514-47db-a4c2-48a0e20e628e-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:31 devstack sudo[91192]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac" returned: 0 in 0.544s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386ac036-aadb-4f45-bf28-25ef8d9bb109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a643d949-dd98-49f3-97b8-f6a304eefc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:31 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac (90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac): created successfully
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a643d949-dd98-49f3-97b8-f6a304eefc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (ddaf99a4-5a41-4ac8-a182-2c2a5f448d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:31 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-96dee401-3694-46db-816c-f6ec9ba04009 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created volume successfully.
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_service.periodic_task [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82678) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:31 devstack sudo[91201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:31 devstack sudo[91201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:31 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" returned: 0 in 0.586s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-537e0e0b-1769-451b-b6ee-7e7debacf72a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82678) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bc3dbd-22d3-4cda-b71e-b4b2508b8fa8]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:31 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a
Apr 22 02:45:31 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:31 devstack sudo[91201]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.437s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:31 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-ac216643-cf54-4653-83d5-003ce65aa51c None None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:32 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a" returned: 0 in 0.482s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:32 devstack sudo[91210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a
Apr 22 02:45:32 devstack sudo[91210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (2d3ad84e-80e8-447e-a529-f455faf8fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44346ded-f469-4485-a892-26a1e051bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44346ded-f469-4485-a892-26a1e051bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73113194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1025dc-7e2e-4ab8-a036-35d56fbaded2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:32Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97500e68-028c-4709-bae1-982a33afef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97500e68-028c-4709-bae1-982a33afef3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca777f2-4cf3-4458-b9ba-147c28fb22bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca777f2-4cf3-4458-b9ba-147c28fb22bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1025dc-7e2e-4ab8-a036-35d56fbaded2', 'volume_name': 'volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7dc732d-f701-4195-a4f6-0188d62e470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7dc732d-f701-4195-a4f6-0188d62e470a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack sudo[91210]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025e16b2-d62d-42bd-98b8-e86bc455899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume 6e1025dc-7e2e-4ab8-a036-35d56fbaded2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2', 'volume_size': 1}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-73113194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1025dc-7e2e-4ab8-a036-35d56fbaded2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:32Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Creating volume 6e1025dc-7e2e-4ab8-a036-35d56fbaded2 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:32 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" returned: 0 in 0.484s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:32 devstack sudo[91215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2 1073741824
Apr 22 02:45:32 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:32 devstack sudo[91217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a
Apr 22 02:45:32 devstack sudo[91217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (1c6a2898-7340-4527-94c3-f40d13b65059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dc1a3e-54cf-41ce-a065-c9d7322bbefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18dc1a3e-54cf-41ce-a065-c9d7322bbefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1544459402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b25fd2-3e58-413d-bf7c-6053ce27e467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:33Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032a82b7-8c8b-4341-a77a-c162f51012ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032a82b7-8c8b-4341-a77a-c162f51012ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16dbc1f-8f2f-4318-9497-2a026e088a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16dbc1f-8f2f-4318-9497-2a026e088a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01b25fd2-3e58-413d-bf7c-6053ce27e467', 'volume_name': 'volume-01b25fd2-3e58-413d-bf7c-6053ce27e467', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae7ba3d-d0cd-4b0d-9212-a764969569e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae7ba3d-d0cd-4b0d-9212-a764969569e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e989096b-5438-4627-9da1-2b042a84d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume 01b25fd2-3e58-413d-bf7c-6053ce27e467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01b25fd2-3e58-413d-bf7c-6053ce27e467', 'volume_size': 1}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (1033225a-f436-4b3b-8bba-6eb5d559c52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ebcf32-9aab-43e7-b75c-d67db4e579f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ebcf32-9aab-43e7-b75c-d67db4e579f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286101021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1458db7-2826-4f00-84f8-7660ecdf7e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:33Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e2da72-fdce-4acb-8f30-b05ea411d85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e2da72-fdce-4acb-8f30-b05ea411d85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2190e12-4bbb-4ff8-ba86-bc03a40c7894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2190e12-4bbb-4ff8-ba86-bc03a40c7894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1458db7-2826-4f00-84f8-7660ecdf7e71', 'volume_name': 'volume-b1458db7-2826-4f00-84f8-7660ecdf7e71', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70621755-67cc-4480-bffb-cce2990e61f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70621755-67cc-4480-bffb-cce2990e61f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edafc99-c85d-44c8-86c1-8add4b98fb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:32 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume b1458db7-2826-4f00-84f8-7660ecdf7e71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1458db7-2826-4f00-84f8-7660ecdf7e71', 'volume_size': 1}
Apr 22 02:45:32 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (98342d6a-1500-45c6-bf89-3db7b7b2ca1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b46831-fdc9-4bd1-9b47-dee3b6cfde3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b46831-fdc9-4bd1-9b47-dee3b6cfde3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1236273140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc73c77-2dbd-4220-96ff-4ee6f5952bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:33Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261a0283-326a-4f6f-8583-11233aaa4c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261a0283-326a-4f6f-8583-11233aaa4c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a9860b-a64c-45af-bcd2-fe4357eb3ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a9860b-a64c-45af-bcd2-fe4357eb3ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc73c77-2dbd-4220-96ff-4ee6f5952bdb', 'volume_name': 'volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea74a735-60d8-4e22-9384-6c7501f43e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea74a735-60d8-4e22-9384-6c7501f43e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab3ec61-7f21-47f9-9667-f7d9d02f1549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume 3dc73c77-2dbd-4220-96ff-4ee6f5952bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb', 'volume_size': 1}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2 1073741824" returned: 0 in 0.583s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:33 devstack sudo[91217]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a.9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" returned: 0 in 0.593s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:33 devstack sudo[91223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2
Apr 22 02:45:33 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a" released by "_delete_snapshot" :: held 2.240s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-537e0e0b-1769-451b-b6ee-7e7debacf72a" released by "delete_snapshot" :: held 2.252s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82678) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (53ea1abf-97b8-4c30-9879-790d3e43fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08db171f-873c-4efb-9609-638c8ab832db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Created reservations ['9c7aeea9-4438-4322-839e-e321f19e3634', '178754ff-d311-40e5-b921-21de8b729d35', '036238f4-e813-4426-aa14-a11afa439598', '464e4625-df46-4b67-94c9-14b0878f3dc8'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08db171f-873c-4efb-9609-638c8ab832db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-56686226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da5139d-ff9c-4b5d-9122-3829aff89a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:33Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa66763-c024-4d04-8301-95cd7f796d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa66763-c024-4d04-8301-95cd7f796d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9244cf3e-b68e-4c9d-86e6-7917d74caabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9244cf3e-b68e-4c9d-86e6-7917d74caabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da5139d-ff9c-4b5d-9122-3829aff89a62', 'volume_name': 'volume-2da5139d-ff9c-4b5d-9122-3829aff89a62', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98efee8b-e0ef-47c9-a7f6-74472481c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98efee8b-e0ef-47c9-a7f6-74472481c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7156802-f00b-4207-9e5b-d802e3e9bafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume 2da5139d-ff9c-4b5d-9122-3829aff89a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da5139d-ff9c-4b5d-9122-3829aff89a62', 'volume_size': 1}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:33 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Delete snapshot completed successfully.
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-41cb442d-1abe-4415-957a-1fc69cc82c46 tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-9555c3b9-f7aa-4a77-ba1d-175fdf20a47a-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:33 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2" returned: 0 in 0.427s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.859s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1544459402',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01b25fd2-3e58-413d-bf7c-6053ce27e467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:33Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Creating volume 01b25fd2-3e58-413d-bf7c-6053ce27e467 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:33 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025e16b2-d62d-42bd-98b8-e86bc455899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467 1073741824
Apr 22 02:45:33 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9615b237-28ee-40d0-b20f-4beb221d7e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:33 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2 (6e1025dc-7e2e-4ab8-a036-35d56fbaded2): created successfully
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9615b237-28ee-40d0-b20f-4beb221d7e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:33 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (2d3ad84e-80e8-447e-a529-f455faf8fae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:33 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2d9f6ff6-0aa7-4a97-b4dc-93541f19d95f tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created volume successfully.
Apr 22 02:45:34 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467 1073741824" returned: 0 in 0.477s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-537e0e0b-1769-451b-b6ee-7e7debacf72a-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:34 devstack sudo[91231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467
Apr 22 02:45:34 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-537e0e0b-1769-451b-b6ee-7e7debacf72a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-quobyte-537e0e0b-1769-451b-b6ee-7e7debacf72a" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-537e0e0b-1769-451b-b6ee-7e7debacf72a" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c846f8-cc78-4e6f-a585-d7e159cd4ab7]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:34 devstack sudo[91233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a
Apr 22 02:45:34 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:34 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467" returned: 0 in 0.436s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286101021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1458db7-2826-4f00-84f8-7660ecdf7e71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:33Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Creating volume b1458db7-2826-4f00-84f8-7660ecdf7e71 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:34 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e989096b-5438-4627-9da1-2b042a84d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01b25fd2-3e58-413d-bf7c-6053ce27e467', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:34 devstack sudo[91236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71 1073741824
Apr 22 02:45:34 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda0d694-327c-43ca-9b76-be5671ced1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:34 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume volume-01b25fd2-3e58-413d-bf7c-6053ce27e467 (01b25fd2-3e58-413d-bf7c-6053ce27e467): created successfully
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda0d694-327c-43ca-9b76-be5671ced1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (1c6a2898-7340-4527-94c3-f40d13b65059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:34 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a6364045-3e5e-4ec6-b2be-a9c72344b7e0 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created volume successfully.
Apr 22 02:45:34 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:34 devstack sudo[91241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a
Apr 22 02:45:34 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:34 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71 1073741824" returned: 0 in 0.473s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:34 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:35 devstack sudo[91247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71
Apr 22 02:45:35 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:35 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-537e0e0b-1769-451b-b6ee-7e7debacf72a" returned: 0 in 0.413s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-537e0e0b-1769-451b-b6ee-7e7debacf72a" released by "delete_volume" :: held 0.940s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Created reservations ['4b8268aa-cc97-4053-a0de-6a197f043416', '0cfe648f-e1b1-4c16-8e9f-a9916b0b3d04', '4bbb0cf3-c2f7-43e5-8f82-88ab8bfe13af', 'aeb1e284-fb7e-4444-8bb0-f58dc98da8a9'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:35 devstack sudo[91249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:35 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-4d19f621-3cd2-4436-a84f-a2eb6049fb18-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-4d19f621-3cd2-4436-a84f-a2eb6049fb18-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "cinder-quobyte-4d19f621-3cd2-4436-a84f-a2eb6049fb18" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-4d19f621-3cd2-4436-a84f-a2eb6049fb18" acquired by "delete_volume" :: waited 0.006s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aa77bc-efdc-4d19-b471-f81bbca4ef01]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:35 devstack sudo[91251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18
Apr 22 02:45:35 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:35 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71" returned: 0 in 0.459s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1236273140',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc73c77-2dbd-4220-96ff-4ee6f5952bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:33Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Creating volume 3dc73c77-2dbd-4220-96ff-4ee6f5952bdb {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:35 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edafc99-c85d-44c8-86c1-8add4b98fb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1458db7-2826-4f00-84f8-7660ecdf7e71', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:35 devstack sudo[91254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb 1073741824
Apr 22 02:45:35 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef714852-0aa2-4d8a-b297-4f094327b402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:35 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume volume-b1458db7-2826-4f00-84f8-7660ecdf7e71 (b1458db7-2826-4f00-84f8-7660ecdf7e71): created successfully
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef714852-0aa2-4d8a-b297-4f094327b402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (1033225a-f436-4b3b-8bba-6eb5d559c52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-917f0ad2-7b48-4a07-8623-8bf777503a8e tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created volume successfully.
Apr 22 02:45:35 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.444s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:35 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Deleted volume successfully.
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-8b089704-a0d5-4bb2-b0ec-6765adfb284c tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-537e0e0b-1769-451b-b6ee-7e7debacf72a-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:35 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18" returned: 0 in 0.534s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:35 devstack sudo[91260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18
Apr 22 02:45:35 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:35 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb 1073741824" returned: 0 in 0.499s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:35 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:35 devstack sudo[91265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb
Apr 22 02:45:35 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:36 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-4d19f621-3cd2-4436-a84f-a2eb6049fb18" returned: 0 in 0.422s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-quobyte-4d19f621-3cd2-4436-a84f-a2eb6049fb18" released by "delete_volume" :: held 0.983s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Created reservations ['ff829d73-58b2-4c69-957a-78888bb42ea0', '15a168a0-739d-465f-8b44-000ad0af9d20', '8ea37ab5-8944-48a8-9090-96d660d89c81', '0465a38a-1352-4b08-bf4d-da11f5d43e42'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:36 devstack sudo[91268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:36 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:36 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb" returned: 0 in 0.488s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.206s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f6971e87310>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-22T00:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-56686226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da5139d-ff9c-4b5d-9122-3829aff89a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d76442eeab4e48ae49364e3f0151a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T00:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T00:45:33Z,use_quota=True,user_id='4153e0e6fffa43a2871b8c6300af600e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2691ac3d-c47c-4189-8fb8-0f5f6a54d747),volume_type_id=2691ac3d-c47c-4189-8fb8-0f5f6a54d747)}" {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.remotefs [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Creating volume 2da5139d-ff9c-4b5d-9122-3829aff89a62 {{(pid=82678) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Selected osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e as target Quobyte volume. {{(pid=82678) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 22 02:45:36 devstack cinder-volume[82678]: INFO cinder.volume.drivers.remotefs [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] casted to osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62 1073741824 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab3ec61-7f21-47f9-9667-f7d9d02f1549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a1c4f4-bf8f-4d4e-8a1d-4d0fdc470b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:36 devstack sudo[91271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62 1073741824
Apr 22 02:45:36 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:36 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb (3dc73c77-2dbd-4220-96ff-4ee6f5952bdb): created successfully
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a1c4f4-bf8f-4d4e-8a1d-4d0fdc470b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (98342d6a-1500-45c6-bf89-3db7b7b2ca1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:36 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-251043b2-cf1e-4560-a521-8b478a110018 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created volume successfully.
Apr 22 02:45:36 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.502s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:36 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Deleted volume successfully.
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-594b4a1b-73b5-44be-8a85-02aacda9eb1c tempest-SnapshotDependencyTests-996625613 None] Lock "cinder-4d19f621-3cd2-4436-a84f-a2eb6049fb18-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:36 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:36 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62 1073741824" returned: 0 in 0.509s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:37 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62
Apr 22 02:45:37 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:37 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62" returned: 0 in 0.451s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'} {{(pid=82678) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7156802-f00b-4207-9e5b-d802e3e9bafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da5139d-ff9c-4b5d-9122-3829aff89a62', 'volume_size': 1}' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5ebb88-b156-406d-8f7d-a8bff2257a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 22 02:45:37 devstack cinder-volume[82678]: INFO cinder.volume.flows.manager.create_volume [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Volume volume-2da5139d-ff9c-4b5d-9122-3829aff89a62 (2da5139d-ff9c-4b5d-9122-3829aff89a62): created successfully
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5ebb88-b156-406d-8f7d-a8bff2257a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82678) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Flow 'volume_create_manager' (53ea1abf-97b8-4c30-9879-790d3e43fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82678) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 22 02:45:37 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-61e327ae-feb8-4841-b7f6-de7101065276 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created volume successfully.
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-2da5139d-ff9c-4b5d-9122-3829aff89a62-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-2da5139d-ff9c-4b5d-9122-3829aff89a62-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-quobyte-2da5139d-ff9c-4b5d-9122-3829aff89a62" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-2da5139d-ff9c-4b5d-9122-3829aff89a62" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[80440d1b-af6a-4ced-8a7f-5a1502fb5a8e]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:37 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:37 devstack sudo[91281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62
Apr 22 02:45:37 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:38 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62" returned: 0 in 0.501s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:38 devstack sudo[91286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62
Apr 22 02:45:38 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:38 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-2da5139d-ff9c-4b5d-9122-3829aff89a62" returned: 0 in 0.453s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-2da5139d-ff9c-4b5d-9122-3829aff89a62" released by "delete_volume" :: held 0.982s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=189,cinder:UPDATE=238,cinder:INSERT=57,cinder:DELETE=27 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created reservations ['940f147b-ccb3-433c-9be0-4009bcf54a5b', '8ff1b9d3-697e-4cf0-872f-63f6e70fdc04', 'ce5a0889-fb08-43fb-a043-dedc3a0fc703', '634222c7-5f4f-47f7-94c7-b8da6c6b0b05'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:38 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:38 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:38 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:39 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.426s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:39 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Deleted volume successfully.
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:UPDATE=288,cinder:SELECT=192,cinder:DELETE=22,cinder:INSERT=67 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-a6bfdba6-dd15-4c2a-9e22-73dea1185998 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-2da5139d-ff9c-4b5d-9122-3829aff89a62-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-quobyte-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb" acquired by "delete_volume" :: waited 0.010s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cc43de-bf5d-430a-a0fc-5c0940569453]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:39 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:39 devstack sudo[91294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb
Apr 22 02:45:39 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:40 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb" returned: 0 in 0.503s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:40 devstack sudo[91300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb
Apr 22 02:45:40 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:40 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb" returned: 0 in 0.487s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb" released by "delete_volume" :: held 1.022s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created reservations ['48dee27a-2a73-4fba-9b05-8111ec3b97d0', 'e1738420-08a4-42db-a1f9-f21dbfeb2fed', '4d046d24-ca5c-477c-b4ef-e29a96ea251f', 'c04619ec-f622-4a05-9f7f-93191ed639ca'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:40 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:40 devstack sudo[91303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:40 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:41 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:41 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.535s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:41 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:41 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Deleted volume successfully.
Apr 22 02:45:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-9c0ece28-2799-4305-98be-969e3f078768 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-3dc73c77-2dbd-4220-96ff-4ee6f5952bdb-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-b1458db7-2826-4f00-84f8-7660ecdf7e71-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:41 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-b1458db7-2826-4f00-84f8-7660ecdf7e71-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-quobyte-b1458db7-2826-4f00-84f8-7660ecdf7e71" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-b1458db7-2826-4f00-84f8-7660ecdf7e71" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e2c52b-cc85-45c6-80ff-2ffbb1db22e9]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:42 devstack sudo[91308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71
Apr 22 02:45:42 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:42 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71" returned: 0 in 0.507s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:42 devstack sudo[91313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71
Apr 22 02:45:42 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:42 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-b1458db7-2826-4f00-84f8-7660ecdf7e71" returned: 0 in 0.409s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-b1458db7-2826-4f00-84f8-7660ecdf7e71" released by "delete_volume" :: held 0.945s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:42 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created reservations ['48325a25-1a4a-4238-82dc-84a9bbcc3989', '8e88df58-4c60-4bc6-9182-77c3be125edb', '9c5cf754-ca62-40a0-9601-c8989dc5c905', 'a7f95395-ac3e-4f62-ba91-bd6ea701a8f0'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:43 devstack sudo[91316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:43 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-01b25fd2-3e58-413d-bf7c-6053ce27e467-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-01b25fd2-3e58-413d-bf7c-6053ce27e467-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-quobyte-01b25fd2-3e58-413d-bf7c-6053ce27e467" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-01b25fd2-3e58-413d-bf7c-6053ce27e467" acquired by "delete_volume" :: waited 0.008s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[660d5b38-3d79-4a35-b3c8-964bf60ad516]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:43 devstack sudo[91318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467
Apr 22 02:45:43 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:43 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.432s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:43 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Deleted volume successfully.
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-62715ff4-e58f-48fa-9f89-066b9e2961b1 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-b1458db7-2826-4f00-84f8-7660ecdf7e71-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:43 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467" returned: 0 in 0.487s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:43 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:43 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467
Apr 22 02:45:43 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:44 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-01b25fd2-3e58-413d-bf7c-6053ce27e467" returned: 0 in 0.412s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-01b25fd2-3e58-413d-bf7c-6053ce27e467" released by "delete_volume" :: held 0.923s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created reservations ['44687b1e-c312-4f8b-b403-3d007715ac6d', '5698756c-b157-4bd6-845b-f2847237459e', 'da78e2ed-d2cc-4c13-9b2b-88340d8088d1', '8f37d689-7b74-4445-957d-dc2bec9d3cc4'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:44 devstack sudo[91327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:44 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-6e1025dc-7e2e-4ab8-a036-35d56fbaded2-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-6e1025dc-7e2e-4ab8-a036-35d56fbaded2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-quobyte-6e1025dc-7e2e-4ab8-a036-35d56fbaded2" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-6e1025dc-7e2e-4ab8-a036-35d56fbaded2" acquired by "delete_volume" :: waited 0.019s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b1a99-fd1f-4f75-bb4c-1ffc233567ab]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:44 devstack sudo[91329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2
Apr 22 02:45:44 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:44 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.426s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:44 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Deleted volume successfully.
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-29ead86d-6124-4e13-8011-2281a3636a99 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-01b25fd2-3e58-413d-bf7c-6053ce27e467-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:44 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2" returned: 0 in 0.465s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:44 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:44 devstack sudo[91335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2
Apr 22 02:45:44 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:45 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-6e1025dc-7e2e-4ab8-a036-35d56fbaded2" returned: 0 in 0.405s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-6e1025dc-7e2e-4ab8-a036-35d56fbaded2" released by "delete_volume" :: held 0.892s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created reservations ['b6b2eb9d-9d57-4221-8821-f6e088b9e3f4', 'c6434eac-4d97-40a5-80b3-3569bf87c6ec', 'e9ed291f-8c92-471e-89e4-d8371a3c5c39', '21b97809-d228-462c-a4f8-8ee25ca99eda'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:45 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:45 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac-delete_volume" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "cinder-quobyte-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac" by "delete_volume" {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac" acquired by "delete_volume" :: waited 0.007s {{(pid=82678) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo.privsep.daemon [-] privsep: reply[25977fbb-3a97-430a-9c98-88513e339702]: (4, 'qcow2') {{(pid=83678) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:45 devstack sudo[91340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac
Apr 22 02:45:45 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:45 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.445s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:45 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Deleted volume successfully.
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-2c5ab4fe-4ba6-47ca-a527-1809d2f73866 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-6e1025dc-7e2e-4ab8-a036-35d56fbaded2-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:45 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac" returned: 0 in 0.472s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:45 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:45 devstack sudo[91348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac
Apr 22 02:45:45 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:46 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98/volume-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac" returned: 0 in 0.411s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-quobyte-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac" released by "delete_volume" :: held 0.904s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG cinder.quota [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Created reservations ['c6d19a5b-532d-4415-a30a-34336d560bbb', '0afbb75f-4626-4167-bc78-f4f2e6241010', '0229534d-2e1c-4b82-ab5a-39cecec385f7', 'b61cf75e-2360-4660-b19e-5f23face12da'] {{(pid=82678) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e': None} {{(pid=82678) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG cinder.volume.drivers.quobyte [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-edda88f5-0981-4b84-82ec-bdc9d35d834e'] {{(pid=82678) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.lockutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82678) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98 {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 22 02:45:46 devstack sudo[91351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98
Apr 22 02:45:46 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 22 02:45:46 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG oslo_concurrency.processutils [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a86ba087275f17a22695694a78fbfc98" returned: 0 in 0.444s {{(pid=82678) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG cinder.manager [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Notifying Schedulers of capabilities ... {{(pid=82678) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 22 02:45:46 devstack cinder-volume[82678]: INFO cinder.volume.manager [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Deleted volume successfully.
Apr 22 02:45:46 devstack cinder-volume[82678]: DEBUG cinder.coordination [None req-69e58a5c-bf2c-46e2-96ee-95e1e704c4b6 tempest-CreateVolumesFromSourceVolumeTest-831567575 None] Lock "cinder-90ba90f2-f9a2-4601-a5e8-5bb36a42e3ac-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=82678) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 22 02:45:56 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=46,cinder:DELETE=2 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 22 02:45:56 devstack cinder-volume[82678]: DEBUG dbcounter [-] [82678] Writing DB stats cinder:INSERT=11,cinder:SELECT=23,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=82678) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}